Wed May 2 04:16:29 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:16:33,927 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:16:33,935 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:16:33,935 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:16:33,935 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:16:33,935 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:16:34,994 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:16:34,994 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:16:34,994 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:16:34,994 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:16:34,995 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:16:34,996 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:16:34,997 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:16:34,997 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:16:34,997 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:16:34,997 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:16:34,998 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020416 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:16:34,999 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:16:35,000 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:16:35,001 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:16:35,002 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020416 2018-05-02 04:16:35,002 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:16:35,002 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:16:35,002 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:16:35,002 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:16:35,003 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:16:35,003 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:16:35,003 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:16:35,003 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:16:35,003 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:16:35,005 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:16:35,006 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020416, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:16:36,542 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:16:36,781 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:16:38,105 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:16:38,116 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:16:38,534 INFO [main] timeline.HadoopTimelineMetricsSink: No suitable collector found. 2018-05-02 04:16:38,599 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:16:39,282 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:16:39,282 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:16:39,373 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:16:40,168 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 04:16:40,211 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:40,216 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:16:40,217 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:16:40,217 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:16:40,217 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:40,218 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:40,506 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:16:40,930 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:16:41,199 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 04:16:41,467 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:16:41,498 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:16:41,535 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:41,536 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:45,024 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:45,121 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:45,423 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:16:45,447 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:16:45,447 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:16:45,447 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:16:45,447 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:16:45,448 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:16:45,448 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:16:45,449 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:16:45,450 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:16:45,452 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@ad3324b 2018-05-02 04:16:45,565 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:16:45,592 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:16:45,615 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:16:45,623 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:16:45 UTC 2018 2018-05-02 04:16:45,623 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:16:45 UTC 2018 2018-05-02 04:16:45,623 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Wed May 02 23:37:05 UTC 2018 2018-05-02 04:16:45,629 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:16:45,642 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:16:45,662 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390009, negotiated timeout = 90000 2018-05-02 04:16:46,011 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085 2018-05-02 04:16:46,500 INFO [main] util.log: Logging initialized @14120ms 2018-05-02 04:16:46,653 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:16:46,670 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:16:46,671 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:16:46,675 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:16:46,675 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:16:46,675 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:16:46,740 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:16:46,747 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:16:47,043 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:16:47,044 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:16:47,617 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@57272109{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:16:47,634 INFO [main] ssl.SslContextFactory: x509=X509@5f69e2b(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@984169e(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:16:47,669 INFO [main] server.AbstractConnector: Started ServerConnector@4d8e2395{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:16:47,669 INFO [main] server.Server: Started @15288ms 2018-05-02 04:17:55,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 5e3858a0-79df-4411-900f-33628cd0efb1 2018-05-02 04:17:55,646 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x150c11d8 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:17:55,658 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$47/1629939346@242474d2 2018-05-02 04:17:55,661 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:17:55,663 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:17:55,664 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:17:55,668 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939000c, negotiated timeout = 90000 2018-05-02 04:17:55,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:17:55,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:17:55,769 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,769 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:17:55,769 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:17:55,769 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:17:55,769 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:17:55,770 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:17:55,770 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:17:55,770 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,771 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,771 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:55,771 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:17:55,771 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:17:56,005 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:17:56,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:17:56,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:17:56,019 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:17:56,019 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:17:56,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:17:56,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:17:56,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:17:56,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:17:56,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:17:56,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:17:56,082 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:17:56,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:17:56,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:17:56,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:17:56,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:17:56,084 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:17:56,084 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,084 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:17:56,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:17:56,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:17:56,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:17:56,195 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:17:56,195 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:17:56,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:17:56,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:17:56,198 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:17:56,205 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:17:56,205 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:17:56,205 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:17:56,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:17:56,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:17:56,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:17:56,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:17:56,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:17:56,209 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,209 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,209 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:17:56,209 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:17:56,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:17:56,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:17:56,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:17:56,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:17:56,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:17:56,220 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:17:56,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:17:56,420 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:56,850 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:59,305 INFO [timeline] timeline.HadoopTimelineMetricsSink: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-05-02 04:17:59,349 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:17:59,904 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=2 2018-05-02 04:18:00,067 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,067 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,067 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:00,068 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:18:00,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:18:00,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525234664535 with port=16020, startcode=1525234595085 2018-05-02 04:18:00,551 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:18:00,899 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:18:00,959 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:18:00,983 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:18:01,054 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:18:01,088 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:18:01,189 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085 starting 2018-05-02 04:18:01,193 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:18:01,202 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:18:01,204 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:18:01,212 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] 2018-05-02 04:18:01,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x2631f08d9390009 2018-05-02 04:18:01,273 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:18:01,273 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:18:04,609 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:18:05,054 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 338 ms, current pipeline: [] 2018-05-02 04:18:05,055 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085.1525234684611 2018-05-02 04:18:30,467 INFO [RpcServer.default.FPBQ.Fifo.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 04:18:30,472 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:18:30,512 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:18:30,688 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085.meta.1525234710512.meta 2018-05-02 04:18:30,905 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:18:30,913 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:18:30,914 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:18:30,914 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:18:30,915 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:18:30,915 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:18:30,926 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 04:18:31,155 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:18:31,176 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:18:31,231 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:18:31,254 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:18:31,255 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:18:31,264 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:18:31,445 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=3 2018-05-02 04:18:31,519 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 04:18:35,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:18:35,966 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:18:35,969 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:18:36,478 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:18:36,826 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:18:36,827 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:18:36,836 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: No suitable collector found. 2018-05-02 04:18:36,842 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:18:36,846 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:18:36,846 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:18:39,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 04:18:39,346 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 04:18:39,346 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 04:18:39,347 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 04:18:55,804 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8] zookeeper.ZooKeeper: Session: 0x2631f08d939000c closed 2018-05-02 04:18:55,804 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x150c11d8-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:19:46,858 INFO [timeline] timeline.HadoopTimelineMetricsSink: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-05-02 04:20:56,950 INFO [timeline] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:21:41,532 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 04:23:35,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:23:35,968 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:23:35,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:23:36,478 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:23:36,720 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:23:36,720 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:23:36,812 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:23:36,812 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:23:36,812 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:23:36,825 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:23:36,829 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:23:36,829 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:23:41,733 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193142ms 2018-05-02 04:23:51,346 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 128784ms 2018-05-02 04:24:01,327 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=2; newVersion=4 2018-05-02 04:24:01,334 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:24:01,334 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:24:01,335 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:24:01,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 179443ms 2018-05-02 04:24:11,157 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 254761ms 2018-05-02 04:24:21,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 70817ms 2018-05-02 04:24:31,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99169ms 2018-05-02 04:24:41,199 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 246526ms 2018-05-02 04:24:51,976 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 108264ms 2018-05-02 04:25:01,144 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91611ms 2018-05-02 04:25:11,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205120ms 2018-05-02 04:25:22,076 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 95454ms 2018-05-02 04:25:31,929 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 197422ms 2018-05-02 04:25:41,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 87740ms 2018-05-02 04:25:51,437 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 33372ms 2018-05-02 04:26:01,562 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 266281ms 2018-05-02 04:26:11,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 32671ms 2018-05-02 04:26:21,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 166114ms 2018-05-02 04:26:31,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 103428ms 2018-05-02 04:26:41,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 49955ms 2018-05-02 04:26:41,531 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 04:26:52,045 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 269580ms 2018-05-02 04:26:54,882 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:26:54,884 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 2/2 column families, memstore data size=11.31 KB memstore heap size=19.21 KB 2018-05-02 04:26:55,089 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=10.44 KB at sequenceid=53 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/b7aed14baa5b43139333fcd371953dd5 2018-05-02 04:26:55,434 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=892 B at sequenceid=53 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/68ea0baaddf442aab52b583d54c75de0 2018-05-02 04:26:55,518 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b7aed14baa5b43139333fcd371953dd5, entries=52, sequenceid=53, filesize=11.1 K 2018-05-02 04:26:55,574 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/68ea0baaddf442aab52b583d54c75de0, entries=9, sequenceid=53, filesize=5.0 K 2018-05-02 04:26:55,579 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~11.31 KB/11586, heap size ~19.63 KB/20104, currentsize=0 B/0 for 1588230740 in 695ms, sequenceid=53, compaction requested=false 2018-05-02 04:26:56,298 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@7123f542 2018-05-02 04:26:56,299 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:26:56,301 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:26:56,302 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 04:26:56,307 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0052, negotiated timeout = 10000 2018-05-02 04:26:56,347 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 04:26:56,365 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 04:26:56,574 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.326 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 04:28:35,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:28:35,965 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:28:35,969 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:28:36,491 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:28:36,837 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:28:36,837 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:28:36,953 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:28:36,953 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:28:36,953 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:28:36,960 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:28:36,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:28:36,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:30:02,165 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=4; newVersion=6 2018-05-02 04:30:02,177 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:30:02,177 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:30:02,177 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:31:41,532 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=623.51 KB, freeSize=818.59 MB, max=819.20 MB, blockCount=2, accesses=42, hits=40, hitRatio=95.24%, , cachingAccesses=42, cachingHits=40, cachingHitsRatio=95.24%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 04:33:02,535 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=6; newVersion=10 2018-05-02 04:33:02,541 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:33:02,541 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:02,541 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:35,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:33:35,965 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:33:35,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:33:36,472 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:33:36,816 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:33:36,817 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:33:36,907 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:33:36,907 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:33:36,907 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:33:36,914 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:33:36,924 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:33:36,924 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:35:32,722 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:673) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.protocol.https.HttpsClient.(HttpsClient.java:264) at sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:367) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:36:32,758 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.SocketTimeoutException: Read timed out at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:171) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1385) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1413) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1397) at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:36:41,531 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=623.51 KB, freeSize=818.59 MB, max=819.20 MB, blockCount=2, accesses=123, hits=121, hitRatio=98.37%, , cachingAccesses=123, cachingHits=121, cachingHitsRatio=98.37%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 04:38:35,965 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:38:35,970 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:38:35,973 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:38:36,476 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:38:36,656 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:38:36,657 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:38:36,709 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:38:36,709 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:38:36,709 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:38:36,713 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:38:36,715 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:38:36,715 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:40:33,376 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=10; newVersion=11 2018-05-02 04:40:33,381 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:40:33,381 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:40:33,381 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:41:41,531 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=623.51 KB, freeSize=818.59 MB, max=819.20 MB, blockCount=2, accesses=126, hits=124, hitRatio=98.41%, , cachingAccesses=126, cachingHits=124, cachingHitsRatio=98.41%, evictions=149, evicted=0, evictedPerRun=0.0 2018-05-02 04:43:35,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:43:35,965 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:43:35,967 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:43:36,473 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:43:36,847 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:43:36,848 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:43:36,969 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:43:36,969 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:43:36,969 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:43:36,978 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:43:36,984 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:43:36,984 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:46:41,531 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=623.51 KB, freeSize=818.59 MB, max=819.20 MB, blockCount=2, accesses=128, hits=126, hitRatio=98.44%, , cachingAccesses=128, cachingHits=126, cachingHitsRatio=98.44%, evictions=179, evicted=0, evictedPerRun=0.0 2018-05-02 04:47:34,595 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=11; newVersion=13 2018-05-02 04:47:34,603 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=44; leafNodeCount=3; singleChildNodeCount=40; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=2; evaluatorListRefCount=42; wildcardEvaluatorListRefCount=42 2018-05-02 04:47:34,603 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:47:34,603 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:48:35,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:48:35,968 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:48:35,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:48:36,474 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:48:36,744 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:48:36,744 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:48:36,874 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:48:36,874 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:48:36,874 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:48:36,885 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:48:36,893 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:48:36,893 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:51:41,531 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=623.51 KB, freeSize=818.59 MB, max=819.20 MB, blockCount=2, accesses=130, hits=128, hitRatio=98.46%, , cachingAccesses=130, cachingHits=128, cachingHitsRatio=98.46%, evictions=209, evicted=0, evictedPerRun=0.0 2018-05-02 04:53:35,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:53:35,966 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:53:35,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:53:36,473 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:53:36,746 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:53:36,747 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:53:36,939 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:53:36,940 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:53:36,940 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:53:36,961 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:53:36,966 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:53:36,966 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:55:35,535 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=13; newVersion=14 2018-05-02 04:55:35,554 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:55:35,555 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:55:35,555 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 Wed May 2 04:56:14 UTC 2018 Terminating regionserver 2018-05-02 04:56:14,492 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 04:56:14,492 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 04:56:14,493 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:56:14,493 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,493 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 04:56:14,493 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 04:56:14,493 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 04:56:14,493 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 04:56:14,493 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 04:56:14,493 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,493 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:56:14,494 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,494 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@3c46dcbe 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,494 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 04:56:14,494 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085' ***** 2018-05-02 04:56:14,495 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,495 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,495 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,495 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,496 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=29:18.244 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 04:56:14,496 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,496 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,496 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,497 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 04:56:14,497 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 04:56:14,497 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 04:56:14,499 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 04:56:14,499 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085 exiting 2018-05-02 04:56:14,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@57272109{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:56:14,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@4d8e2395{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:56:14,520 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 04:56:14,521 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 04:56:14,530 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 04:56:14,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 04:56:14,531 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 04:56:14,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 04:56:14,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085 2018-05-02 04:56:14,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x150c11d8 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:56:14,532 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 04:56:14,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 04:56:14,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 04:56:14,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 04:56:14,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,535 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 04:56:14,536 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,604 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 04:56:14,735 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085; all regions closed. 2018-05-02 04:56:14,784 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085.meta:.meta(num 1525234710512) 2018-05-02 04:56:14,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525234595085:(num 1525234684611) 2018-05-02 04:56:14,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 04:56:14,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS]] on shutdown 2018-05-02 04:56:14,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 04:56:14,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 04:56:14,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 04:56:14,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x2631f08d9390009 closed 2018-05-02 04:56:14,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085; zookeeper connection closed. 2018-05-02 04:56:14,995 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:56:14,995 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 04:56:14,997 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 04:57:53 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:57:57,490 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:57:57,493 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:57:57,493 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:57:57,493 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:57:57,493 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:57:58,268 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:57:58,268 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:57:58,268 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:57:58,268 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:57:58,270 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:57:58,271 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:57:58,272 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:58,273 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:57:58,274 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:57:58,275 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:57:58,277 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:57:58,278 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:57:58,278 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:57:58,281 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:57:58,282 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020457, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:57:59,458 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:57:59,545 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:58:00,276 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:58:00,284 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 04:58:00,976 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:58:00,976 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:58:00,976 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:58:01,169 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:58:01,454 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:58:01,454 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:58:01,486 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:58:01,983 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 04:58:02,009 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:58:02,012 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:58:02,012 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:58:02,013 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:58:02,013 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:58:02,013 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:58:02,193 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:58:02,421 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:58:02,544 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 04:58:02,948 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:58:02,971 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:58:02,984 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:58:02,986 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:58:04,619 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:58:04,638 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:58:04,738 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:58:04,746 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:58:04,747 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:58:04,747 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:58:04,747 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:58:04,747 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:58:04,747 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:58:04,748 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:58:04,749 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 04:58:04,794 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:58:04,797 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:58:04,814 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:58:04 UTC 2018 2018-05-02 04:58:04,814 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:58:04 UTC 2018 2018-05-02 04:58:04,814 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:18:48 UTC 2018 2018-05-02 04:58:04,815 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:58:04,825 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:58:04,837 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:58:04,848 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390043, negotiated timeout = 90000 2018-05-02 04:58:04,988 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 2018-05-02 04:58:05,219 INFO [main] util.log: Logging initialized @9519ms 2018-05-02 04:58:05,330 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:58:05,351 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:58:05,352 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:58:05,361 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:58:05,361 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:58:05,362 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:58:05,426 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:58:05,428 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:58:05,536 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:58:05,537 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:58:05,950 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:58:05,958 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:58:05,979 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:58:05,980 INFO [main] server.Server: Started @10280ms 2018-05-02 04:58:06,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 04:58:06,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x1103ff99 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:58:06,164 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1387704154@17b42b68 2018-05-02 04:58:06,166 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:58:06,168 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:58:06,169 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:58:06,173 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390044, negotiated timeout = 90000 2018-05-02 04:58:06,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:58:06,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:58:06,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:58:06,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:58:06,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:58:06,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:58:06,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:58:06,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:58:06,641 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:58:06,642 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:58:06,647 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:58:06,648 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:58:06,707 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:58:06,707 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:58:06,707 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:58:06,707 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:58:06,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:58:06,709 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:58:06,722 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:58:06,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:58:06,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:58:06,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:58:06,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:58:06,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:58:06,724 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:58:06,724 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:58:06,724 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:58:06,734 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:58:06,734 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:58:06,734 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:58:06,734 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:58:06,788 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:58:06,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:58:06,830 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:58:06,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:58:06,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:58:06,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:58:06,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:58:06,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:58:06,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:58:06,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:58:06,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:58:06,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:58:06,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:58:06,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:58:06,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:58:06,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:58:06,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:58:06,844 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:58:06,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:58:06,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:58:06,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:58:06,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:58:06,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:58:06,873 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:58:06,879 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:58:07,043 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:58:07,426 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:58:10,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=14 2018-05-02 04:58:10,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:58:10,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:58:10,686 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:58:10,687 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:58:10,688 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:58:10,707 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237056151 with port=16020, startcode=1525237078341 2018-05-02 04:58:11,208 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:58:11,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:58:11,482 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:58:11,543 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:58:11,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:58:11,555 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:58:11,670 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:58:11,793 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 starting 2018-05-02 04:58:11,798 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:58:11,805 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:58:11,807 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:58:11,825 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237076568, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949] other RSs: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237076568, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949] 2018-05-02 04:58:11,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x2631f08d9390043 2018-05-02 04:58:11,862 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:58:11,862 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:58:14,920 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237078341, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:58:15,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 312 ms, current pipeline: [] 2018-05-02 04:58:15,318 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237078341.1525237094921 2018-05-02 04:59:06,206 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99] zookeeper.ZooKeeper: Session: 0x2631f08d9390044 closed 2018-05-02 04:59:06,206 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1103ff99-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:00:41,277 INFO [Thread-22] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=14; newVersion=16 2018-05-02 05:00:41,296 INFO [Thread-22] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:00:41,296 INFO [Thread-22] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:00:41,296 INFO [Thread-22] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:01:11,392 INFO [Thread-22] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=16; newVersion=18 2018-05-02 05:01:11,402 INFO [Thread-22] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:01:11,402 INFO [Thread-22] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:01:11,402 INFO [Thread-22] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:02:45,225 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:02:45,230 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 1315ms. 2018-05-02 05:02:46,548 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1237ms. 2018-05-02 05:02:47,788 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 3381ms. 2018-05-02 05:02:51,172 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 9761ms. 2018-05-02 05:03:00,936 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 8564ms. 2018-05-02 05:03:02,983 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:03:09,503 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 10667ms. 2018-05-02 05:03:20,173 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 16143ms. 2018-05-02 05:03:36,320 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 12687ms. 2018-05-02 05:03:51,837 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Trying to failover after sleeping for 14906ms. 2018-05-02 05:04:06,776 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 12023ms. 2018-05-02 05:04:18,804 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 16589ms. 2018-05-02 05:04:35,403 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 15458ms. 2018-05-02 05:04:50,867 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 11959ms. 2018-05-02 05:05:02,832 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 4 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-266403605_1. Name node is in safe mode. The reported blocks 191 has reached the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 4 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 10658ms. 2018-05-02 05:05:26,664 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:05:26,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:05:26,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:05:26,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:05:26,897 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:05:26,899 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:05:26,899 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:05:26,980 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:05:26,983 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:05:27,007 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:05:27,129 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:05:27,143 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:05:27,272 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:05:27,296 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:05:27,425 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=18 2018-05-02 05:05:27,474 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:05:31,477 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:05:31,478 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:05:31,479 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:05:31,929 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:05:31,931 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:05:31,932 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:05:32,439 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:05:32,702 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:05:32,702 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:05:32,793 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:05:32,793 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:05:32,793 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:05:32,802 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:05:32,814 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:05:32,814 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:05:33,953 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@2da361a7 2018-05-02 05:05:33,955 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:05:33,956 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:05:33,957 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:05:33,960 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790062, negotiated timeout = 10000 2018-05-02 05:05:33,999 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:05:34,019 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:06:06,912 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 05:08:02,982 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 Wed May 2 05:08:17 UTC 2018 Terminating regionserver 2018-05-02 05:08:17,096 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:08:17,096 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:08:17,097 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:08:17,097 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:08:17,097 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:08:17,097 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:08:17,097 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:08:17,097 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:17,097 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:08:17,097 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:08:17,097 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:08:17,097 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:08:17,097 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:08:17,098 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:08:17,097 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:08:17,098 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:08:17,098 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:08:17,098 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:08:17,098 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:17,098 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:08:17,099 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341' ***** 2018-05-02 05:08:17,099 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:17,098 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:17,100 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:43.189 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 05:08:17,101 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:17,101 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:17,101 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:08:17,101 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:17,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:08:17,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:08:17,102 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:08:17,102 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 exiting 2018-05-02 05:08:17,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:08:17,123 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:08:17,124 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:08:17,124 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:08:17,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:08:17,128 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:08:17,128 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:08:17,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:08:17,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:08:17,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:17,131 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 2018-05-02 05:08:17,131 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x1103ff99 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:08:17,132 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:17,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 05:08:17,268 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:08:17,333 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341; all regions closed. 2018-05-02 05:08:17,422 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237078341:(num 1525237094921) 2018-05-02 05:08:17,424 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 05:08:17,425 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:08:17,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:08:17,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:08:17,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:08:17,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:08:17,427 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 05:08:17,428 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:08:17,583 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x2631f08d9390043 closed 2018-05-02 05:08:17,583 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341; zookeeper connection closed. 2018-05-02 05:08:17,583 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:08:17,584 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:08:17,585 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:09:32 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:09:34,636 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:09:34,638 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:09:34,638 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:09:34,638 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:09:34,638 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:09:35,017 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:09:35,017 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:09:35,017 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:09:35,017 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:35,018 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:09:35,019 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:09:35,020 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:09:35,021 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:09:35,022 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:09:35,023 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:09:35,024 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:09:35,024 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:09:35,024 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:09:35,026 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:09:35,027 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020509, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:09:35,220 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:09:35,760 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:09:35,814 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:09:36,449 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:09:36,456 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:09:36,983 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:36,984 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:09:36,984 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:09:37,049 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:09:37,196 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:09:37,196 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:09:37,224 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:09:37,565 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 05:09:37,590 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:37,593 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:09:37,594 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:09:37,594 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:09:37,595 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:37,595 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:37,890 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:09:38,203 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:09:38,234 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:09:38,381 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 05:09:38,574 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:38,582 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:09:38,584 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:09:38,599 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:38,601 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:38,607 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:09:39,944 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:39,960 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:40,079 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:09:40,092 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:09:40,093 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:40,093 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:09:40,093 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:09:40,093 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:09:40,093 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:09:40,095 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:09:40,097 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:09:40,138 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:09:40,139 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:09:40,146 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:40,154 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:40,162 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:09:40 UTC 2018 2018-05-02 05:09:40,163 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:09:40 UTC 2018 2018-05-02 05:09:40,163 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:27:04 UTC 2018 2018-05-02 05:09:40,164 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:09:40,175 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390061, negotiated timeout = 90000 2018-05-02 05:09:40,178 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:09:40,179 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061 connected 2018-05-02 05:09:40,212 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:09:40,302 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:40,307 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:09:40,371 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:40,374 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:09:40,374 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:09:40,379 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:40,385 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:40,438 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:09:40,438 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:40,438 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:40,481 INFO [main] util.log: Logging initialized @6646ms 2018-05-02 05:09:40,689 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:09:40,716 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:09:40,717 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:09:40,721 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:09:40,721 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:09:40,721 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:09:40,782 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:09:40,784 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:09:40,861 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:09:40,862 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:09:41,084 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:09:41,089 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:09:41,103 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:09:41,103 INFO [main] server.Server: Started @7268ms 2018-05-02 05:09:41,130 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:09:41,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:09:41,161 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:09:41,161 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:09:41,165 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:09:41,197 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x38f8788e to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:09:41,206 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/936677381@72d6189b 2018-05-02 05:09:41,208 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:41,209 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:41,209 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:09:41,213 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790067, negotiated timeout = 90000 2018-05-02 05:09:41,268 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f55b86a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:09:41,270 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@262c6262, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 05:09:41,276 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 05:09:41,290 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:09:41,290 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:41,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:41,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:41,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:09:41,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:09:41,514 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:09:41,517 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:09:41,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:09:41,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:09:41,526 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:09:41,526 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:09:41,576 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:09:41,577 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:09:41,577 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:09:41,577 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:09:41,577 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:09:41,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:09:41,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:09:41,588 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:41,588 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:09:41,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:41,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:09:41,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:09:41,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:41,639 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:09:41,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:09:41,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:09:41,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:41,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:41,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:09:41,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:09:41,672 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:09:41,677 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:09:41,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:09:41,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:09:41,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:09:41,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:09:41,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:41,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:41,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:09:41,679 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:09:41,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:09:41,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:09:41,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:41,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:41,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:09:41,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:09:41,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:09:41,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:09:41,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:09:41,684 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:09:41,700 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:09:41,700 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:09:41,936 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:09:42,265 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:09:44,290 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:09:44,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:09:44,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:09:44,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:09:44,423 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:09:44,423 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:09:44,471 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525237775059 2018-05-02 05:09:44,681 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:09:44,685 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:09:44,686 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:09:44,868 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:09:44,893 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:09:44,939 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:09:44,943 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:09:44,945 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:09:44,946 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:09:44,946 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:09:45,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:09:45,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:09:45,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:09:45,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:09:45,107 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:09:45,388 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:09:45,411 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:09:45,473 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:09:45,490 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:09:45,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:09:45,523 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:09:45,709 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:09:45,709 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:09:45,709 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:09:45,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:09:45,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:09:45,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:09:45,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:09:45,769 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:09:45,853 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 starting 2018-05-02 05:09:45,857 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:09:45,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:09:45,869 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:09:45,887 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:09:45,896 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:09:45,907 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237076568, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241] 2018-05-02 05:09:45,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x2631f08d9390061 2018-05-02 05:09:45,980 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:09:45,980 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:09:45,980 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059' 2018-05-02 05:09:45,980 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:09:45,981 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:09:45,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:09:45,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:09:45,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:09:45,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059' 2018-05-02 05:09:45,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:09:45,983 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:09:45,983 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:09:45,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:09:45,984 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:09:47,221 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:09:47,222 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:09:49,062 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237775059, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:09:49,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 346 ms, current pipeline: [] 2018-05-02 05:09:49,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237775059.1525237789063 2018-05-02 05:09:49,539 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:09:52,551 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:09:54,004 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,006 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:09:54,007 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,010 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,010 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:09:54,011 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:09:54,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:09:54,020 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/1 2018-05-02 05:09:54,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,301 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:10:03,591 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:10:41,247 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e] zookeeper.ZooKeeper: Session: 0x3631f08b2790067 closed 2018-05-02 05:10:41,247 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x38f8788e-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:11:09,696 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,704 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:09,704 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,750 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:09,768 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,769 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:09,770 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,771 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,771 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:09,944 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:10,108 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:10,109 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:10,110 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:10,118 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:10,215 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:11:10,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:11:10,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:11:10,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:11:10,221 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:11:10,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:11:10,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 05:11:10,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:10,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:10,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:11:10,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 05:11:10,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:10,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:10,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:11:10,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:10,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 05:11:10,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:11:10,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:10,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:10,301 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:10,301 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:10,301 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:10,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 05:11:10,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:10,303 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:10,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:11:10,305 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:10,305 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:10,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:10,301 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:10,301 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:10,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:11:10,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 05:11:10,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:10,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:10,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:11:10,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:11:10,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:10,307 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:10,307 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:10,307 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:10,315 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:10,315 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:10,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:10,350 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:10,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,370 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,370 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:10,559 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:11:10,559 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:11:10,559 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:11:10,559 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:11:10,559 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:11:10,561 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:11:10,559 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:11:10,567 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:11:10,569 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:11:10,567 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:11:10,620 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,623 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,624 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,625 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,627 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:10,642 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,642 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,642 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,643 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,644 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:10,680 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,680 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,680 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,680 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,680 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:10,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:11:10,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:11:10,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:11:10,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:11:10,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:11:10,800 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,800 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,800 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=2 2018-05-02 05:11:10,800 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,800 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=2 2018-05-02 05:11:10,800 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=2 2018-05-02 05:11:10,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,802 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=2 2018-05-02 05:11:10,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:10,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=2 2018-05-02 05:11:10,851 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:10,851 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:10,852 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:10,853 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:10,854 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:10,878 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:10,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:10,879 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:10,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:10,879 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:10,880 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:10,880 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:10,880 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:10,881 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:10,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:11,735 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@72f3cdfa 2018-05-02 05:11:11,738 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:11:11,740 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:11:11,740 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:11:11,744 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390068, negotiated timeout = 10000 2018-05-02 05:11:11,788 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:11:11,802 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:11:13,257 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281." 2018-05-02 05:11:13,293 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a6e0d7561c4f19e78f94d37462588281 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,299 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,299 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 05:11:13,300 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:13,313 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96." 2018-05-02 05:11:13,314 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close da9e02fc1fdd80392463141e6bc6cf96 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,315 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136." 2018-05-02 05:11:13,315 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1d954f21d711345a9587d995cecea136 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,316 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,316 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 05:11:13,317 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:13,317 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b." 2018-05-02 05:11:13,317 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 2859fac3bc772763b3fd1621c2669f2b without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,317 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 05:11:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:13,329 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11." 2018-05-02 05:11:13,329 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b5180eee96b616afdf79578309c66a11 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,384 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,384 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,387 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:13,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,390 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:13,391 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,393 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:13,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:13,395 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,395 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 05:11:13,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 05:11:13,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:13,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:13,398 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,398 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,398 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,399 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:13,405 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:13,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,446 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,449 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:13,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,452 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:13,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:13,460 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:14,674 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:14,702 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:14,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:11:14,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 05:11:14,704 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 05:11:14,704 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,704 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:14,704 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,704 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 05:11:14,704 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:14,706 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,706 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:11:14,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:14,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:11:14,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:11:14,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:11:14,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 05:11:14,709 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 05:11:14,709 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,710 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,710 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:14,710 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:11:14,710 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,710 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,710 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 05:11:14,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:11:14,710 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,711 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,711 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:11:14,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:11:14,712 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,712 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,712 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:11:14,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:11:14,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:11:14,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:11:14,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:11:14,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:11:14,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:11:14,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:14,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:11:14,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:14,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:11:14,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:11:14,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:14,721 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:14,722 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,750 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:11:14,750 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:11:14,755 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,756 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,761 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:11:14,761 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:11:14,769 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,770 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,774 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,777 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:11:14,777 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:11:14,779 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,779 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:11:14,780 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:11:14,780 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,781 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,782 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,784 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,794 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,795 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,798 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:11:14,798 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:11:14,808 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,810 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:11:14,826 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:11:14,830 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:11:14,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:11:14,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:11:14,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,986 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,987 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,987 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,995 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=5 2018-05-02 05:11:14,998 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=5 2018-05-02 05:11:14,999 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:15,001 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:15,002 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=5 2018-05-02 05:11:15,002 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:15,004 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=5 2018-05-02 05:11:15,010 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:15,011 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=5 2018-05-02 05:11:15,016 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:11:15,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:15,023 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:11:15,023 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:15,026 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:15,029 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:15,030 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:11:15,030 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:15,036 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:11:15,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:15,038 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:11:15,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:11:15,344 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:11:15,346 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:11:15,350 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:11:15,858 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:11:15,879 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:11:15,881 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:15,881 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,885 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:15,892 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,892 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:15,894 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,894 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:15,895 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:16,641 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:11:16,642 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:11:17,052 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:11:17,053 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:11:17,053 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:11:17,091 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:11:17,096 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:11:17,096 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:11:17,167 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:11:17,215 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:17,215 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:11:17,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:17,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:11:17,217 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:17,217 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:11:18,252 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:11:18,253 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:18,254 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,257 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:18,263 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,263 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:18,305 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:18,306 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:18,306 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:19,288 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 175 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:30,335 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:30,336 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 127 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:30,346 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 135 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:30,346 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:39,742 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 153 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:41,726 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.026 minutes, events=357, succcessCount=132, totalEvents=357, totalSuccessCount=132 2018-05-02 05:11:45,468 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 180 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:45,469 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 181 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:45,469 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 181 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:45,469 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 181 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:47,107 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 185 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:48,965 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 179 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:48,966 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 180 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:48,967 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 181 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:48,971 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 185 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:48,972 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 184 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:49,487 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:11:50,278 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 140 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:50,280 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 143 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:51,680 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 165 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:52,916 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 139 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:52,922 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 142 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:52,924 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 145 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:52,924 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 146 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:11:52,924 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 144 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:12:11,707 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=247, succcessCount=247, totalEvents=247, totalSuccessCount=247 2018-05-02 05:12:31,456 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 108 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:12:44,709 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.984 minutes, events=725, succcessCount=276, totalEvents=1082, totalSuccessCount=408 2018-05-02 05:12:47,716 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:12:47,716 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:12:47,716 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 102 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:12:47,717 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 103 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:01,919 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 109 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:04,939 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 157 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:04,940 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 157 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:05,582 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:05,582 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:05,583 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 101 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:05,583 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 101 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:08,763 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 103 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:13:11,755 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.048 minutes, events=276, succcessCount=276, totalEvents=523, totalSuccessCount=523 2018-05-02 05:13:44,760 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.051 minutes, events=396, succcessCount=161, totalEvents=1478, totalSuccessCount=569 2018-05-02 05:13:49,832 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:13:49,840 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1149ms. 2018-05-02 05:13:50,992 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 1499ms. 2018-05-02 05:13:52,494 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 5780ms. 2018-05-02 05:13:58,276 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 7189ms. 2018-05-02 05:14:05,468 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 19884ms. 2018-05-02 05:14:25,355 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 17058ms. 2018-05-02 05:14:38,596 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:14:42,416 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 21940ms. 2018-05-02 05:14:45,897 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:14:45,902 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=7, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:15:07,052 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 7942ms. 2018-05-02 05:15:15,018 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_871323370_1. Name node is in safe mode. The reported blocks 113 needs additional 123 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_871323370_1. Name node is in safe mode. The reported blocks 113 needs additional 123 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 12566ms. 2018-05-02 05:15:27,591 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_871323370_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_871323370_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 15682ms. 2018-05-02 05:16:15,343 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:16:15,347 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:16:15,355 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:16:15,875 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:16:16,285 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:16:16,285 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:16:16,449 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:16:16,449 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:16:16,449 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:16:16,460 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:16:16,464 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:16:16,464 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:17:39,905 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:17:39,912 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 znode expired, triggering replicatorRemoved event 2018-05-02 05:17:39,912 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:17:40,293 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:17:40,294 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:17:40,294 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:17:40,298 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:17:40,300 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:17:40,300 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:17:40,301 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:17:40,301 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:17:40,301 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:17:40,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:40,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:40,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:17:40,335 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 05:17:40,336 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:17:40,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 05:17:40,339 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:17:40,339 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:17:40,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:17:40,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:17:40,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:40,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 05:17:40,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:17:40,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:17:40,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:17:40,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:17:40,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:17:40,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:17:40,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:17:40,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:17:40,344 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:17:40,344 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:17:40,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:17:40,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:17:40,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:40,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 05:17:40,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:17:40,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 05:17:40,345 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:17:40,345 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:17:40,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:17:40,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 05:17:40,346 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:17:40,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:17:40,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:17:40,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:40,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:40,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:40,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:17:40,350 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:17:40,351 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:40,352 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:40,392 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:17:40,392 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:17:40,393 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:17:40,394 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:17:40,458 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:17:40,458 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:17:40,459 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:17:40,460 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:17:40,460 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:17:40,460 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:17:40,461 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:17:40,461 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:17:40,640 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 05:17:40,640 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:17:40,641 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:17:40,641 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:17:40,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:17:40,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:17:40,660 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 05:17:40,660 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:17:40,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:17:40,766 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12516.seqid, newMaxSeqId=12516, maxSeqId=12515 2018-05-02 05:17:40,766 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12776.seqid, newMaxSeqId=12776, maxSeqId=12775 2018-05-02 05:17:40,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12731.seqid, newMaxSeqId=12731, maxSeqId=12730 2018-05-02 05:17:40,778 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12776 2018-05-02 05:17:40,782 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12516 2018-05-02 05:17:40,783 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:40,784 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:40,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12731 2018-05-02 05:17:40,807 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:40,860 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:40,860 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:40,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:17:40,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:17:40,861 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:40,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:17:41,772 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=04:30.017 minutes, events=46, succcessCount=46, totalEvents=569, totalSuccessCount=569 2018-05-02 05:17:44,771 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=2, succcessCount=1, totalEvents=1480, totalSuccessCount=570 2018-05-02 05:17:45,345 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:17:45,346 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:17:45,348 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:17:45,855 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:17:46,266 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:17:46,266 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:17:46,345 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:17:46,346 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:17:46,346 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:17:46,352 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:17:46,353 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:17:46,353 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:18:23,487 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:18,533 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 2018-05-02 05:19:18,538 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 znode expired, triggering replicatorRemoved event 2018-05-02 05:19:18,539 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:19,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:19:19,049 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:19:19,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 05:19:19,050 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:19:19,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 05:19:19,050 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:19:19,050 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:19:19,050 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:19:19,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 05:19:19,051 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:19:19,051 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:19:19,052 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:19:19,052 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:19:19,052 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:19:19,065 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:19:19,065 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:19:19,066 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:19,067 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:19,095 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 05:19:19,096 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:19,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:19:19,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12273.seqid, newMaxSeqId=12273, maxSeqId=12272 2018-05-02 05:19:19,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12273 2018-05-02 05:19:19,149 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:19:19,153 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:19:19,153 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:19:23,783 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:42.011 minutes, events=1, succcessCount=1, totalEvents=570, totalSuccessCount=570 2018-05-02 05:19:24,052 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:19:24,054 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:19:24,057 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:19:24,563 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:19:24,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:19:24,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:19:24,932 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:19:24,932 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:19:24,932 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:19:24,940 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:19:24,943 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:19:24,943 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:19:38,596 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:19:44,783 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=2, succcessCount=1, totalEvents=1482, totalSuccessCount=571 2018-05-02 05:19:45,893 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=7, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:19:45,897 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:19:50,867 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:20:09,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b." 2018-05-02 05:20:09,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Close 9c38689b653a37956f2ae7364b126f1b, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241. Requested from /172.27.59.154 2018-05-02 05:20:09,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827." 2018-05-02 05:20:09,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Close 78e8a528d65332a4f7661e8ab427a827, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134. Requested from /172.27.59.154 2018-05-02 05:20:09,251 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:09,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 05:20:09,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:09,252 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:09,252 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:20:09,252 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12733.seqid, newMaxSeqId=12733, maxSeqId=12731 2018-05-02 05:20:09,333 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12778.seqid, newMaxSeqId=12778, maxSeqId=12776 2018-05-02 05:20:09,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:09,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:09,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:09,342 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:09,342 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 9c38689b653a37956f2ae7364b126f1b move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 record at close sequenceid=12731 2018-05-02 05:20:09,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:09,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:09,344 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:09,345 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,345 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 78e8a528d65332a4f7661e8ab427a827 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 record at close sequenceid=12776 2018-05-02 05:20:09,347 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:20:09,347 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:10,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74." 2018-05-02 05:20:10,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Close 51c9fc854cbebfa25ed419e23bd8ac74, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241. Requested from /172.27.59.154 2018-05-02 05:20:10,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136." 2018-05-02 05:20:10,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Close 1d954f21d711345a9587d995cecea136, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427. Requested from /172.27.59.154 2018-05-02 05:20:10,144 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:10,144 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:10,144 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 05:20:10,144 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 05:20:10,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:10,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:10,146 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.97 MB memstore heap size=2.95 MB 2018-05-02 05:20:10,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12275.seqid, newMaxSeqId=12275, maxSeqId=12273 2018-05-02 05:20:10,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:10,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:10,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:10,183 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:10,183 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 51c9fc854cbebfa25ed419e23bd8ac74 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 record at close sequenceid=12273 2018-05-02 05:20:10,187 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:20:10,960 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.97 MB at sequenceid=12529 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/.tmp/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:20:11,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/.tmp/test_cf/5e3da6c9f6924f878ff6491016ba25bf as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:20:11,090 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf, entries=13618, sequenceid=12529, filesize=2.0 M 2018-05-02 05:20:11,110 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.97 MB/2063243, heap size ~2.95 MB/3094896, currentsize=0 B/0 for 1d954f21d711345a9587d995cecea136 in 964ms, sequenceid=12529, compaction requested=false 2018-05-02 05:20:11,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12532.seqid, newMaxSeqId=12532, maxSeqId=5 2018-05-02 05:20:11,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:11,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:11,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:11,168 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,168 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 1d954f21d711345a9587d995cecea136 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 record at close sequenceid=12529 2018-05-02 05:20:11,172 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281." 2018-05-02 05:20:11,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Close a6e0d7561c4f19e78f94d37462588281, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427. Requested from /172.27.59.154 2018-05-02 05:20:11,370 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:11,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 05:20:11,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:11,371 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.11 MB memstore heap size=3.17 MB 2018-05-02 05:20:11,659 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.11 MB at sequenceid=13448 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/.tmp/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:20:11,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/.tmp/test_cf/456e1d1536eb4c76a936bf52d24b8c27 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:20:11,709 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27, entries=14594, sequenceid=13448, filesize=2.2 M 2018-05-02 05:20:11,712 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.11 MB/2216546, heap size ~3.17 MB/3322120, currentsize=0 B/0 for a6e0d7561c4f19e78f94d37462588281 in 341ms, sequenceid=13448, compaction requested=false 2018-05-02 05:20:11,757 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13451.seqid, newMaxSeqId=13451, maxSeqId=5 2018-05-02 05:20:11,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:11,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:11,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:11,764 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:11,764 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding a6e0d7561c4f19e78f94d37462588281 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 record at close sequenceid=13448 2018-05-02 05:20:11,768 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:13,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:20:13,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:20:13,632 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 05:20:13,633 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:13,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 05:20:13,633 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:13,633 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:13,633 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:13,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 05:20:13,635 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:13,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:13,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:20:13,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:20:13,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:13,650 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:20:13,650 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:20:13,652 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:13,652 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:13,681 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 05:20:13,681 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:13,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:20:13,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12771.seqid, newMaxSeqId=12771, maxSeqId=12770 2018-05-02 05:20:13,725 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12771 2018-05-02 05:20:13,727 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:20:13,731 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:20:13,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:20:14,342 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:14,344 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:14,349 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:14,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:20:14,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:20:14,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 05:20:14,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:14,432 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 05:20:14,432 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:14,432 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:14,432 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 05:20:14,433 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:14,433 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:20:14,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:20:14,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:20:14,505 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:20:14,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:14,536 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:20:14,536 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:20:14,537 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:14,542 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:14,604 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:20:14,615 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/9a15d9bb66554f11aa0429ce82724413 2018-05-02 05:20:14,650 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/a09cc6d66c9d40afb5210ff9303caf73 2018-05-02 05:20:14,651 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:14,662 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:20:14,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/33.seqid, newMaxSeqId=33, maxSeqId=32 2018-05-02 05:20:14,700 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=33 2018-05-02 05:20:14,704 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:20:14,709 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:20:14,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:20:14,854 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:15,152 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:15,152 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:20:15,253 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:20:15,253 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:15,253 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:15,263 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:15,265 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:15,266 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:17,234 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:20:19,433 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:19,434 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:19,436 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:19,940 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:20,163 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:20,163 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:20:20,246 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:20:20,246 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:20,246 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:20,253 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:20,271 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:20,272 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:44,787 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=8, succcessCount=4, totalEvents=1490, totalSuccessCount=575 2018-05-02 05:20:45,174 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 2018-05-02 05:20:45,177 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 znode expired, triggering replicatorRemoved event 2018-05-02 05:20:45,177 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:20:45,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:20:45,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:20:45,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 05:20:45,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 05:20:45,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 05:20:45,657 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,657 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 05:20:45,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:20:45,658 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:45,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:20:45,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 05:20:45,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 05:20:45,672 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,672 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 05:20:45,672 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:20:45,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:20:45,680 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 05:20:45,680 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 05:20:45,681 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,683 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,694 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:20:45,694 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:20:45,695 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,696 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,740 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 05:20:45,740 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 05:20:45,758 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 05:20:45,759 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:20:45,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13629.seqid, newMaxSeqId=13629, maxSeqId=13628 2018-05-02 05:20:45,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13629 2018-05-02 05:20:45,790 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:20:45,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=15 2018-05-02 05:20:45,801 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:20:45,801 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:20:45,806 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=16 2018-05-02 05:20:45,809 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:20:45,816 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:20:45,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:20:47,236 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:20:47,787 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:24.004 minutes, events=5, succcessCount=5, totalEvents=575, totalSuccessCount=575 2018-05-02 05:20:50,658 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:50,659 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:50,661 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:51,169 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:51,412 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:51,413 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:20:51,505 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:20:51,505 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:51,505 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:51,512 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:51,515 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:51,515 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:21:15,342 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:21:15,344 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:21:15,346 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:21:15,852 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:21:16,128 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:21:16,129 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:21:16,214 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:21:16,214 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:21:16,214 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:21:16,221 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:21:16,224 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:21:16,224 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:21:20,448 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:21:44,790 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=2, succcessCount=1, totalEvents=1492, totalSuccessCount=576 Wed May 2 05:22:11 UTC 2018 Terminating regionserver 2018-05-02 05:22:11,988 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:22:11,988 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:22:11,988 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:22:11,989 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:22:11,989 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:22:11,989 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:22:11,989 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:22:11,989 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:22:11,990 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:22:11,991 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:24.203 minutes, events=1, succcessCount=1, totalEvents=576, totalSuccessCount=576 2018-05-02 05:22:11,991 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:22:11,991 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:22:11,991 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:22:11,991 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:22:11,991 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:22:11,991 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:22:11,991 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:22:11,992 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:22:11,992 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:22:11,993 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059' ***** 2018-05-02 05:22:11,993 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:11,995 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:11,995 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:22:11,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:22:11,995 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:22:11,998 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:22:11,998 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 exiting 2018-05-02 05:22:12,015 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:22:12,023 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:22:12,023 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:22:12,023 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:22:12,030 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:22:12,030 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:22:12,030 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:22:12,030 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:22:12,030 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:22:12,031 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,031 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,032 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 05:22:12,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,033 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.90 MB memstore heap size=2.86 MB 2018-05-02 05:22:12,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:22:12,033 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:22:12,034 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x38f8788e to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:22:12,034 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:22:12,034 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 8 regions to close 2018-05-02 05:22:12,034 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,034 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Online Regions={b5180eee96b616afdf79578309c66a11=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11., aa977fc80ff408457e9257d2ab7afdf2=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2., 91f73e76bbe7bc8a61b1b1299d34c6ab=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab., 8dc6fd2022c2fdf8c065fbd16cadaaca=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca., da9e02fc1fdd80392463141e6bc6cf96=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96., 2859fac3bc772763b3fd1621c2669f2b=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b., 1182d8ac9fbcff5334cd5fda2cf0c4a0=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0., 60955ebb25dcf0aeb6d46e894a921538=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.} 2018-05-02 05:22:12,034 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 05:22:12,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:22:12,035 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 05:22:12,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:22:12,086 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12518.seqid, newMaxSeqId=12518, maxSeqId=12516 2018-05-02 05:22:12,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12773.seqid, newMaxSeqId=12773, maxSeqId=12771 2018-05-02 05:22:12,098 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,098 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,098 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,098 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:22:12,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:22:12,099 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 05:22:12,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:22:12,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,106 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:22:12,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:22:12,106 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 05:22:12,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:22:12,110 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.00 MB memstore heap size=3.00 MB 2018-05-02 05:22:12,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=33 2018-05-02 05:22:12,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,155 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:22:12,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:22:12,156 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 05:22:12,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:22:12,157 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.99 MB memstore heap size=2.99 MB 2018-05-02 05:22:12,213 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.90 MB at sequenceid=12140 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/.tmp/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:22:12,221 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.00 MB at sequenceid=12737 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/.tmp/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 05:22:12,249 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.99 MB at sequenceid=12700 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/.tmp/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 05:22:12,254 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/.tmp/test_cf/7a69b14b3a874236a929721884c99143 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:22:12,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/.tmp/test_cf/5524750f28964bae9802836f5884fdd1 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 05:22:12,274 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/.tmp/test_cf/a0c5ddf407ab4960b0c246592b2cd164 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 05:22:12,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143, entries=13195, sequenceid=12140, filesize=2.0 M 2018-05-02 05:22:12,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1, entries=13818, sequenceid=12737, filesize=2.1 M 2018-05-02 05:22:12,284 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.90 MB/1996871, heap size ~2.86 MB/2996528, currentsize=0 B/0 for b5180eee96b616afdf79578309c66a11 in 252ms, sequenceid=12140, compaction requested=false 2018-05-02 05:22:12,284 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.00 MB/2098696, heap size ~3.00 MB/3145168, currentsize=0 B/0 for da9e02fc1fdd80392463141e6bc6cf96 in 178ms, sequenceid=12737, compaction requested=false 2018-05-02 05:22:12,297 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164, entries=13795, sequenceid=12700, filesize=2.1 M 2018-05-02 05:22:12,298 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.99 MB/2090082, heap size ~2.99 MB/3135336, currentsize=0 B/0 for 2859fac3bc772763b3fd1621c2669f2b in 142ms, sequenceid=12700, compaction requested=false 2018-05-02 05:22:12,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12740.seqid, newMaxSeqId=12740, maxSeqId=5 2018-05-02 05:22:12,305 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12143.seqid, newMaxSeqId=12143, maxSeqId=5 2018-05-02 05:22:12,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,307 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:22:12,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:22:12,308 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 05:22:12,308 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:22:12,309 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,309 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,310 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,310 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,310 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,310 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,310 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 05:22:12,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:22:12,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12703.seqid, newMaxSeqId=12703, maxSeqId=5 2018-05-02 05:22:12,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,318 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:22:12,319 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:22:12,325 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13631.seqid, newMaxSeqId=13631, maxSeqId=13629 2018-05-02 05:22:12,333 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,333 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,333 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,334 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:22:12,334 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 05:22:12,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/18.seqid, newMaxSeqId=18, maxSeqId=16 2018-05-02 05:22:12,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:22:12,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:22:12,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:12,339 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:22:12,340 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:22:12,436 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059; all regions closed. 2018-05-02 05:22:12,436 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:22:12,468 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:22:12,468 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525237775059:(num 1525237789063) 2018-05-02 05:22:12,468 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:22:12,469 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 05:22:12,469 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:22:12,470 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:22:12,470 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:22:12,470 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:22:12,470 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:22:12,474 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 05:22:12,474 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:22:12,475 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:22:12,526 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:22:12,526 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390061, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:22:12,629 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:22:12,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x2631f08d9390061 closed 2018-05-02 05:22:12,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059; zookeeper connection closed. 2018-05-02 05:22:12,630 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:22:12,631 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:22:35 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:22:38,107 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:22:38,109 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:22:38,109 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:22:38,109 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:22:38,109 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:22:38,455 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:22:38,456 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:22:38,456 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:22:38,456 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:22:38,457 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:22:38,458 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020522 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:22:38,459 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:22:38,460 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:22:38,461 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020522 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:22:38,462 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:22:38,464 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:22:38,465 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020522, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:22:38,642 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:22:39,009 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:22:39,058 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:22:39,630 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:22:39,639 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:22:40,239 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:22:40,239 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:22:40,239 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:22:40,293 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:22:40,559 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:22:40,559 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:22:40,604 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:22:41,067 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 05:22:41,095 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:22:41,098 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:22:41,099 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:22:41,099 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:22:41,099 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:22:41,100 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:22:41,284 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:22:41,551 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:22:41,574 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:22:41,719 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 05:22:41,853 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:22:41,855 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:22:41,856 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:22:41,866 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:22:41,867 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:22:41,872 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:22:43,548 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:22:43,560 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:22:43,636 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:22:43,644 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:22:43,644 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:22:43,645 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:22:43,646 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:22:43,646 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:22:43,646 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:22:43,646 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:22:43,647 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:22:43,679 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:22:43,680 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:22:43,689 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:22:43,695 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:22:43 UTC 2018 2018-05-02 05:22:43,695 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:22:43 UTC 2018 2018-05-02 05:22:43,695 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:25:17 UTC 2018 2018-05-02 05:22:43,697 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:22:43,705 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:22:43,714 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00b7, negotiated timeout = 90000 2018-05-02 05:22:43,716 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:22:43,717 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7 connected 2018-05-02 05:22:43,742 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:22:43,817 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:22:43,817 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:22:43,822 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:22:43,883 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:22:43,886 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:22:43,887 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:22:43,891 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:22:43,895 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:22:43,937 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:22:43,937 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:22:43,937 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:22:43,981 INFO [main] util.log: Logging initialized @6929ms 2018-05-02 05:22:44,110 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:22:44,128 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:22:44,129 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:22:44,132 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:22:44,132 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:22:44,133 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:22:44,186 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:22:44,189 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:22:44,263 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:22:44,264 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:22:44,477 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:22:44,485 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:22:44,506 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:22:44,507 INFO [main] server.Server: Started @7455ms 2018-05-02 05:22:44,566 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:22:44,573 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:22:44,608 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:22:44,608 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:22:44,615 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:22:44,666 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x628fd49f to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:22:44,699 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/887427401@71e799b1 2018-05-02 05:22:44,701 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:22:44,702 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:22:44,706 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:22:44,711 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279006e, negotiated timeout = 90000 2018-05-02 05:22:44,787 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a2b23e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:22:44,791 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63572e8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 05:22:44,801 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 05:22:44,820 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:22:44,821 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:22:44,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:22:44,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:22:44,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:22:44,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:22:44,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:22:44,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:22:45,089 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:22:45,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:22:45,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:22:45,099 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:22:45,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:22:45,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:22:45,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:22:45,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:22:45,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:22:45,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:22:45,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:22:45,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:22:45,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:22:45,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:22:45,178 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:22:45,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:22:45,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:22:45,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:22:45,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:22:45,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:22:45,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:22:45,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:22:45,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:22:45,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:22:45,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:22:45,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:22:45,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:22:45,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:22:45,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:22:45,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:22:45,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:22:45,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:22:45,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:22:45,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:22:45,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:22:45,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:22:45,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:22:45,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:22:45,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:22:45,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:22:45,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:22:45,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:22:45,279 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:22:45,279 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:22:45,527 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:22:45,799 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:22:47,916 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:22:48,025 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:22:48,026 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:22:48,026 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:22:48,031 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:22:48,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:22:48,047 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525238558502 2018-05-02 05:22:48,134 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:22:48,135 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:22:48,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:22:48,242 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:22:48,256 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:22:48,280 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:22:48,282 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:22:48,284 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:22:48,285 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:22:48,285 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:22:48,331 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:22:48,331 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:22:48,331 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:22:48,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:22:48,392 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:22:48,694 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:22:48,710 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:22:48,781 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:22:48,795 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:22:48,798 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:22:48,829 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:22:48,882 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:22:48,882 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:22:48,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:22:48,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:22:48,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:22:48,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:22:48,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:22:48,983 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:22:49,094 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 starting 2018-05-02 05:22:49,095 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:22:49,099 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:22:49,102 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:22:49,106 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:22:49,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:22:49,119 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] other RSs: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] 2018-05-02 05:22:49,161 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x1631f08b26c00b7 2018-05-02 05:22:49,162 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:22:49,162 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:22:49,162 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502' 2018-05-02 05:22:49,162 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:22:49,163 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:22:49,164 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:22:49,164 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:22:49,164 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:22:49,164 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502' 2018-05-02 05:22:49,164 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:22:49,165 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:22:49,166 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:22:49,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:22:49,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:22:50,589 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:22:50,590 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:22:52,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:22:52,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 256 ms, current pipeline: [] 2018-05-02 05:22:52,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502.1525238572271 2018-05-02 05:22:52,626 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:23:44,842 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f] zookeeper.ZooKeeper: Session: 0x3631f08b279006e closed 2018-05-02 05:23:44,842 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x628fd49f-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:23:51,089 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:51,094 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 znode expired, triggering replicatorRemoved event 2018-05-02 05:23:51,095 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:23:52,557 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:23:52,563 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:23:52,563 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:23:52,572 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:23:52,584 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:23:52,585 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:23:52,586 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:23:52,587 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:23:52,588 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:23:52,734 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:52,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:23:52,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:23:52,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:23:52,917 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:23:52,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:23:52,918 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:23:52,918 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:23:52,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:23:52,922 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:23:52,922 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:23:52,957 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:23:52,958 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:53,003 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:53,151 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:23:53,151 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:23:53,207 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:23:53,240 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:23:53,400 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:23:53,405 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:23:53,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:23:53,485 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12982.seqid, newMaxSeqId=12982, maxSeqId=12981 2018-05-02 05:23:53,490 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12982 2018-05-02 05:23:53,533 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:53,560 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:23:53,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:23:54,781 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:23:57,315 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@3844753b 2018-05-02 05:23:57,317 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:23:57,318 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:23:57,319 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:23:57,322 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00b9, negotiated timeout = 10000 2018-05-02 05:23:57,357 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:23:57,364 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:23:57,958 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:23:57,959 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:23:57,962 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:23:58,471 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:23:58,780 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:23:58,781 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:23:58,898 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:23:58,898 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:23:58,898 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:23:58,906 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:23:58,909 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:23:58,909 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:24:00,584 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:24:00,584 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:24:00,585 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:24:00,585 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:24:00,586 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:24:00,586 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:24:32,552 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:24:45,289 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 05:25:07,445 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:25:07,468 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:25:07,469 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:25:07,471 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 05:25:07,471 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:07,472 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 05:25:07,472 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:07,472 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:07,472 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:07,472 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 05:25:07,473 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:07,473 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:07,474 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:25:07,474 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:25:07,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:07,486 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:25:07,487 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 05:25:07,487 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:07,487 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 05:25:07,487 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:07,487 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:07,487 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:07,488 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 05:25:07,488 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:07,488 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:07,488 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:25:07,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:25:07,499 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:25:07,500 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 05:25:07,504 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:07,506 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:07,549 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:25:07,552 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 05:25:07,552 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:07,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:25:07,555 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:07,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 05:25:07,574 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:25:07,574 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:25:07,575 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:07,576 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:07,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12777.seqid, newMaxSeqId=12777, maxSeqId=12776 2018-05-02 05:25:07,613 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12777 2018-05-02 05:25:07,614 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:25:07,620 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/9a15d9bb66554f11aa0429ce82724413 2018-05-02 05:25:07,623 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:25:07,628 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:25:07,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:07,643 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/a09cc6d66c9d40afb5210ff9303caf73 2018-05-02 05:25:07,644 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:07,655 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:25:07,683 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/39.seqid, newMaxSeqId=39, maxSeqId=38 2018-05-02 05:25:07,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=39 2018-05-02 05:25:07,692 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:25:07,698 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:25:07,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:08,010 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62." 2018-05-02 05:25:08,031 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 665f3f34ec072c60acee3dc78af73b62, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606. Requested from /172.27.59.154 2018-05-02 05:25:08,035 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:08,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:25:08,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:08,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12984.seqid, newMaxSeqId=12984, maxSeqId=12982 2018-05-02 05:25:08,114 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:08,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:08,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:08,118 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:08,118 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 665f3f34ec072c60acee3dc78af73b62 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 record at close sequenceid=12982 2018-05-02 05:25:08,123 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:25:11,124 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:11,152 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:25:11,153 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 05:25:11,153 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:11,153 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 05:25:11,153 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:11,153 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:11,153 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:11,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 05:25:11,154 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:11,154 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:11,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:25:11,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:11,154 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,168 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:25:11,168 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:25:11,170 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:11,171 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:11,212 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 05:25:11,212 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:11,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:25:11,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12232.seqid, newMaxSeqId=12232, maxSeqId=12231 2018-05-02 05:25:11,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12232 2018-05-02 05:25:11,277 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:11,290 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:11,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:11,962 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:11,975 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:25:11,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:25:11,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:11,976 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:25:11,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:11,976 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:11,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:11,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:25:11,977 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:11,977 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:11,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:25:11,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:11,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,998 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:25:11,998 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:25:12,000 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:12,000 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:12,032 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:25:12,032 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:12,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:25:12,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12536.seqid, newMaxSeqId=12536, maxSeqId=12535 2018-05-02 05:25:12,098 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12536 2018-05-02 05:25:12,104 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:12,110 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:12,111 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:12,187 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:12,198 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:25:12,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:25:12,199 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:12,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:25:12,199 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:12,199 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:12,199 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:12,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:25:12,200 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:12,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:12,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:25:12,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:12,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:12,216 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:25:12,216 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:25:12,218 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:12,218 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:12,242 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:25:12,243 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:12,250 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:25:12,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12147.seqid, newMaxSeqId=12147, maxSeqId=12146 2018-05-02 05:25:12,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12147 2018-05-02 05:25:12,280 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:12,287 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:12,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:12,290 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:15.006 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 05:25:12,475 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:25:12,477 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:25:12,478 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:25:12,991 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:25:13,024 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:13,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 05:25:13,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 05:25:13,037 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:13,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 05:25:13,037 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:13,037 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:13,037 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:13,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 05:25:13,037 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:13,037 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:13,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 05:25:13,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:13,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:13,054 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 05:25:13,054 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 05:25:13,056 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:13,056 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:13,097 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 05:25:13,097 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:13,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 05:25:13,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11347.seqid, newMaxSeqId=11347, maxSeqId=11346 2018-05-02 05:25:13,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11347 2018-05-02 05:25:13,137 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:13,141 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:13,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:25:13,279 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:25:13,280 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:25:13,347 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:25:13,347 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:25:13,347 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:25:13,352 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:25:13,354 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:25:13,354 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:25:13,369 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:25:18,038 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:25:18,039 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:25:18,041 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:25:18,562 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:25:18,831 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:25:18,831 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:25:18,958 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:25:18,958 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:25:18,958 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:25:18,966 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:25:18,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:25:18,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:25:45,290 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=10, succcessCount=5, totalEvents=12, totalSuccessCount=6 2018-05-02 05:26:05,113 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:07,744 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:07,750 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:08,120 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:11,122 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:26:11,122 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:11,122 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:26:11,124 DEBUG [RS-EventLoopGroup-1-6] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:11,131 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:26:11,139 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:26:11,140 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:26:11,148 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:26:11,149 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:26:11,149 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:27:09,003 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,005 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:27:09,006 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,009 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,011 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:27:09,012 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:09,015 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:27:09,015 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:09,015 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:27:09,015 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/2 2018-05-02 05:27:09,016 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:37,272 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,274 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:37,274 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,278 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:37,280 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,280 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:37,281 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,281 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,282 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:37,286 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:37,340 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:37,340 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:37,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:27:37,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:27:37,342 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:37,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 05:27:37,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 05:27:37,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:27:37,342 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 05:27:37,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 05:27:37,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 05:27:37,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 05:27:37,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 05:27:37,344 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 05:27:37,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:37,345 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:27:37,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:37,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 05:27:37,347 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,347 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 05:27:37,347 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:27:37,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:37,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,354 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:37,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:27:37,358 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 05:27:37,358 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,358 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 05:27:37,358 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,358 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,359 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 05:27:37,359 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,358 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:27:37,359 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:27:37,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:37,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 05:27:37,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 05:27:37,361 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,361 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,361 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 05:27:37,362 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,362 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:27:37,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:37,364 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,480 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:27:37,480 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:27:37,483 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,485 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,531 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,537 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:27:37,537 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:27:37,539 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,540 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,541 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 05:27:37,550 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:27:37,550 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:27:37,553 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,553 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:27:37,553 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:27:37,555 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,555 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,556 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,557 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:27:37,568 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:27:37,568 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:27:37,569 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,569 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,572 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,574 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,576 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:27:37,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:27:37,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:27:37,645 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,645 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=2 2018-05-02 05:27:37,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,660 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=2 2018-05-02 05:27:37,664 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:37,665 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,665 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=2 2018-05-02 05:27:37,667 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,667 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=2 2018-05-02 05:27:37,668 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:37,670 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:37,674 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:37,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:37,678 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:37,682 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:37,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:37,682 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:37,683 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:37,683 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,683 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=2 2018-05-02 05:27:37,688 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:37,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:37,712 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:37,721 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:37,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:37,912 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,914 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:37,915 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,920 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:37,921 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,921 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:37,922 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,922 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,923 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:38,525 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9." 2018-05-02 05:27:38,526 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close e75a388bc2011feed75bdc1a0e99a9a9 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,528 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c." 2018-05-02 05:27:38,528 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 84c55bda386b9aa62a8b4df75ca9b38c without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,528 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,528 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6." 2018-05-02 05:27:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 735f841820ff0baa687bc402b169f4a6 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,529 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 05:27:38,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:38,531 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4." 2018-05-02 05:27:38,532 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a0620fc83de532a37f6a9bb8f99cc6c4 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,532 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81." 2018-05-02 05:27:38,532 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a0792481dc7d859b1b63b04bf9adad81 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,536 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,536 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 05:27:38,536 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:38,640 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,654 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,656 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:38,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:38,686 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 05:27:38,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:38,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:38,696 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,696 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 05:27:38,697 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:38,699 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:38,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,792 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,792 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,792 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,792 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,792 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:38,793 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,793 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,793 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:38,805 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:38,805 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:40,579 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:40,608 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:40,608 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:40,608 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:40,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:27:40,609 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:40,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:27:40,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:27:40,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 05:27:40,612 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 05:27:40,612 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 05:27:40,612 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:27:40,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 05:27:40,612 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 05:27:40,612 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,612 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,612 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 05:27:40,613 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,613 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:27:40,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:27:40,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 05:27:40,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 05:27:40,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 05:27:40,612 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 05:27:40,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 05:27:40,616 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,616 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 05:27:40,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:40,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,614 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,617 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:27:40,617 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:40,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,614 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 05:27:40,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 05:27:40,620 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,620 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 05:27:40,620 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,620 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:27:40,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:40,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 05:27:40,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:27:40,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:40,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,661 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:27:40,662 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:27:40,662 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:27:40,662 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:27:40,663 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,663 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,663 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:27:40,663 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:27:40,664 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,664 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,665 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,665 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,665 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:27:40,665 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:27:40,667 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,669 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,678 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,680 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,682 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,683 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,698 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:27:40,698 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:27:40,700 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,702 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,742 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:27:40,766 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:27:40,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 05:27:40,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:27:40,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:27:40,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=5 2018-05-02 05:27:40,979 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:40,988 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:27:40,988 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:40,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:40,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=5 2018-05-02 05:27:40,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=5 2018-05-02 05:27:40,996 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,003 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:41,003 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:41,005 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=5 2018-05-02 05:27:41,017 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=5 2018-05-02 05:27:41,021 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:41,021 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:41,033 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:27:41,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:41,047 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:27:41,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:41,054 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:27:41,054 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:41,055 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:27:41,055 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:27:41,864 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:27:41,896 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:27:41,898 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:41,898 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:41,901 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:41,908 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:41,909 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:41,912 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:41,912 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:41,912 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:42,301 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:30.012 minutes, events=5, succcessCount=5, totalEvents=6, totalSuccessCount=6 2018-05-02 05:27:42,345 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:27:42,347 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:27:42,350 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:27:42,689 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:27:42,690 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:42,690 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,693 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:42,704 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,704 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:42,708 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,708 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:42,709 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:42,856 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:27:43,434 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:27:43,434 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:27:43,534 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:27:43,534 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:27:43,534 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:27:43,544 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:27:43,550 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:27:43,550 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:27:43,584 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:27:45,298 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=20, succcessCount=6, totalEvents=32, totalSuccessCount=12 2018-05-02 05:27:49,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=6, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:27:49,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:27:50,967 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 101 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:50,968 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 101 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:54,554 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 130 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:54,555 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:54,555 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:54,556 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:54,556 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:27:56,548 DEBUG [RS-EventLoopGroup-1-11] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:27:59,558 DEBUG [RS-EventLoopGroup-1-12] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:01,614 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:01,623 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:02,563 DEBUG [RS-EventLoopGroup-1-13] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:05,569 DEBUG [RS-EventLoopGroup-1-14] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:28:05,579 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:28:05,588 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:28:05,589 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:28:05,591 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:28:05,593 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:28:05,593 DEBUG [RS-EventLoopGroup-1-14] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:28:12,180 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 112 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:12,184 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 117 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:12,184 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 116 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:12,801 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 101 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:18,902 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 116 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:18,903 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 116 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:23,812 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 167 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:23,814 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 168 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:28:42,313 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.011 minutes, events=260, succcessCount=260, totalEvents=266, totalSuccessCount=266 2018-05-02 05:28:45,299 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=867, succcessCount=277, totalEvents=899, totalSuccessCount=289 2018-05-02 05:28:57,956 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:28:57,958 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:28:57,975 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:28:58,510 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:28:58,859 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:28:58,860 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:28:58,983 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:28:58,983 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:28:58,983 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:28:58,992 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:28:58,995 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:28:58,995 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:29:15,031 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 149 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:15,031 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 151 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:15,032 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 151 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:30,645 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 173 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:30,645 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 174 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:30,645 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 175 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:32,280 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 108 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 05:29:42,315 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=276, succcessCount=276, totalEvents=542, totalSuccessCount=542 2018-05-02 05:29:45,300 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=649, succcessCount=276, totalEvents=1548, totalSuccessCount=565 2018-05-02 05:30:23,130 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:30:45,318 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.018 minutes, events=326, succcessCount=92, totalEvents=1874, totalSuccessCount=657 2018-05-02 05:30:53,155 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:30:53,157 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 749ms. 2018-05-02 05:30:53,908 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 2409ms. 2018-05-02 05:30:56,320 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 4898ms. 2018-05-02 05:31:01,220 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 5861ms. 2018-05-02 05:31:07,084 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 12505ms. 2018-05-02 05:31:19,592 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 7582ms. 2018-05-02 05:31:27,176 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 18445ms. 2018-05-02 05:31:45,624 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 11502ms. 2018-05-02 05:31:58,565 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 0 needs additional 304 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 0 needs additional 304 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 16402ms. 2018-05-02 05:32:14,972 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 20100ms. 2018-05-02 05:32:35,079 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 12444ms. 2018-05-02 05:32:41,863 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:32:47,527 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-9284900_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 20823ms. 2018-05-02 05:32:49,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=8, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:32:49,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:33:57,956 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:33:57,958 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:33:57,962 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:33:58,468 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:33:58,853 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:33:58,854 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:33:58,961 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:33:58,961 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:33:58,961 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:33:58,970 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:33:58,975 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:33:58,975 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:35:05,946 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:35:05,949 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 znode expired, triggering replicatorRemoved event 2018-05-02 05:35:05,949 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:35:06,789 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:35:06,791 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:35:06,791 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,793 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:35:06,796 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,796 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:35:06,797 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:35:06,797 DEBUG [RS-EventLoopGroup-1-15] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:35:06,797 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:35:06,800 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:06,841 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:06,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:35:06,843 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 05:35:06,843 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,843 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 05:35:06,843 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,843 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,843 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 05:35:06,844 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,844 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:35:06,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:06,846 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:35:06,898 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:35:06,898 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:35:06,898 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:35:06,898 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:35:06,898 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:35:06,898 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:35:06,901 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:35:06,902 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:35:06,902 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:35:06,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:35:06,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:06,903 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:06,918 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:35:06,918 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:35:06,921 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,922 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:06,944 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:35:06,944 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:35:06,945 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:06,946 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:35:07,175 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:35:07,175 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:35:07,278 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 05:35:07,278 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:35:07,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:35:07,353 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11983.seqid, newMaxSeqId=11983, maxSeqId=11982 2018-05-02 05:35:07,381 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11983 2018-05-02 05:35:07,387 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:07,392 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:07,393 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:35:07,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12797.seqid, newMaxSeqId=12797, maxSeqId=12796 2018-05-02 05:35:07,446 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12797 2018-05-02 05:35:07,453 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:07,457 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:07,457 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:35:11,845 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:35:11,846 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:35:11,848 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:35:12,328 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=05:30.013 minutes, events=115, succcessCount=115, totalEvents=657, totalSuccessCount=657 2018-05-02 05:35:12,356 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:35:12,782 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:35:12,782 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:35:12,899 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:35:12,899 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:35:12,899 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:35:12,906 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:35:12,911 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:35:12,911 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:35:45,331 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=4, succcessCount=2, totalEvents=1878, totalSuccessCount=659 2018-05-02 05:35:50,847 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:36:42,935 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 2018-05-02 05:36:42,937 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 znode expired, triggering replicatorRemoved event 2018-05-02 05:36:42,938 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:36:43,401 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 05:36:43,403 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:36:43,417 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:36:43,480 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502.meta.1525239403417.meta 2018-05-02 05:36:43,480 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:36:43,485 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:36:43,486 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 05:36:43,486 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:43,486 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 05:36:43,486 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:43,486 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:43,486 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:43,487 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 05:36:43,487 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:43,487 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:43,491 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 05:36:43,499 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 05:36:43,500 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 05:36:43,500 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 05:36:43,500 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 05:36:43,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:36:43,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:36:43,532 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:43,532 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:43,590 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/0dfe0ed19753464191b56446e8e389e2 2018-05-02 05:36:43,616 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/54483b733579430883426bf0af441c53 2018-05-02 05:36:43,651 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/7c74cf8435a143bfad871d0d73876907 2018-05-02 05:36:43,652 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:43,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:36:43,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:36:43,666 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:43,667 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:43,715 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 2018-05-02 05:36:43,754 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4 2018-05-02 05:36:43,754 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:43,788 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 05:36:43,810 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 05:36:43,838 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/627.seqid, newMaxSeqId=627, maxSeqId=626 2018-05-02 05:36:43,849 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=627 2018-05-02 05:36:43,853 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 05:36:43,858 DEBUG [PostOpenDeployTasks:1588230740] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:36:43,859 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:43,861 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 05:36:43,862 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 05:36:43,862 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:36:43,880 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store hbase:meta,,1.1588230740; time since last major compaction 771794ms 2018-05-02 05:36:43,886 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.HStore: 1588230740 - info: Initiating major compaction (all files) 2018-05-02 05:36:43,886 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 05:36:43,887 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/0dfe0ed19753464191b56446e8e389e2, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/54483b733579430883426bf0af441c53, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/7c74cf8435a143bfad871d0d73876907] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=200.9 K 2018-05-02 05:36:43,891 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] compactions.Compactor: Compacting 0dfe0ed19753464191b56446e8e389e2, keycount=510, bloomtype=NONE, size=87.1 K, encoding=NONE, seqNum=360, earliestPutTs=1525237106084 2018-05-02 05:36:43,895 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] compactions.Compactor: Compacting 54483b733579430883426bf0af441c53, keycount=547, bloomtype=NONE, size=94.8 K, encoding=NONE, seqNum=598, earliestPutTs=1525238632260 2018-05-02 05:36:43,896 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] compactions.Compactor: Compacting 7c74cf8435a143bfad871d0d73876907, keycount=88, bloomtype=NONE, size=18.9 K, encoding=NONE, seqNum=623, earliestPutTs=1525239306563 2018-05-02 05:36:44,014 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:36:44,016 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:36:44,016 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 736 for processing by saslServer.evaluateResponse() 2018-05-02 05:36:44,018 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 107 from saslServer. 2018-05-02 05:36:44,020 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:36:44,020 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:36:44,021 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:36:44,021 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:36:44,021 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:36:44,081 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] throttle.PressureAwareThroughputController: 1588230740#info#compaction#0 average throughput is 0.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 05:36:44,422 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:36:44,439 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:36:44,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => dc953453430fbf031584084fad7c31bd, NAME => 'test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:36:44,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 05:36:44,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AuthenticationService 2018-05-02 05:36:44,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 05:36:44,440 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=SecureBulkLoadService 2018-05-02 05:36:44,440 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:36:44,440 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,440 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 05:36:44,440 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,440 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:36:44,440 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:36:44,440 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AccessControlService 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 05:36:44,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:36:44,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase dc953453430fbf031584084fad7c31bd 2018-05-02 05:36:44,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:36:44,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:36:44,490 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:36:44,491 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:36:44,492 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 05:36:44,492 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 05:36:44,492 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,492 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:36:44,492 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,493 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:36:44,599 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/ba1eb1029b494bc3812c1db310fffa4e as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e 2018-05-02 05:36:44,623 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf/d830ee103d2b41e0ad35903c835935d7 2018-05-02 05:36:44,623 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,639 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 05:36:44,639 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:36:44,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd 2018-05-02 05:36:44,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 05:36:44,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12675.seqid, newMaxSeqId=12675, maxSeqId=12674 2018-05-02 05:36:44,795 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.HStore: Completed major compaction of 3 (all) file(s) in info of 1588230740 into ba1eb1029b494bc3812c1db310fffa4e(size=150.0 K), total size for store is 150.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 05:36:44,796 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=7, startTime=1525239403857; duration=0sec 2018-05-02 05:36:44,799 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525239403858] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 05:36:44,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened dc953453430fbf031584084fad7c31bd; next sequenceid=12675 2018-05-02 05:36:44,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12187.seqid, newMaxSeqId=12187, maxSeqId=12186 2018-05-02 05:36:44,814 INFO [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:36:44,818 DEBUG [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:36:44,819 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12187 2018-05-02 05:36:44,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:36:44,829 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:36:44,831 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:36:44,832 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:36:45,332 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:33.004 minutes, events=2, succcessCount=2, totalEvents=659, totalSuccessCount=659 2018-05-02 05:36:45,341 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.010 minutes, events=6, succcessCount=3, totalEvents=1884, totalSuccessCount=662 2018-05-02 05:36:48,500 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:36:48,501 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:36:48,503 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:36:48,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/0dfe0ed19753464191b56446e8e389e2, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/54483b733579430883426bf0af441c53, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/7c74cf8435a143bfad871d0d73876907] to archive 2018-05-02 05:36:48,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archiving compacted files. 2018-05-02 05:36:49,008 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:36:49,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/0dfe0ed19753464191b56446e8e389e2 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/0dfe0ed19753464191b56446e8e389e2 2018-05-02 05:36:49,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/54483b733579430883426bf0af441c53 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/54483b733579430883426bf0af441c53 2018-05-02 05:36:49,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/7c74cf8435a143bfad871d0d73876907 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/7c74cf8435a143bfad871d0d73876907 2018-05-02 05:36:49,329 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:36:49,330 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:36:49,436 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:36:49,436 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:36:49,436 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:36:49,445 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:36:49,450 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:36:49,450 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:36:49,659 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:36:50,583 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:36:50,584 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 05:37:21,798 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:37:41,864 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=156.66 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=2, accesses=40, hits=9, hitRatio=22.50%, , cachingAccesses=16, cachingHits=9, cachingHitsRatio=56.25%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 05:37:49,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=9, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:37:49,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:38:17,669 DEBUG [RS-EventLoopGroup-1-17] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:38:17,671 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:38:17,671 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,671 DEBUG [RS-EventLoopGroup-1-18] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:38:17,672 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:38:17,672 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,673 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:38:17,674 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,674 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:38:17,674 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:38:17,675 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,675 DEBUG [RS-EventLoopGroup-1-17] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:38:17,675 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:38:17,676 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,676 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:38:17,677 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:17,677 DEBUG [RS-EventLoopGroup-1-18] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:38:17,677 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:38:17,995 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:17,996 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:38:18,000 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,000 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,001 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:18,004 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:38:18,009 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:38:18,010 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:38:18,010 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:38:18,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/3 2018-05-02 05:38:18,010 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:38:18,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 2018-05-02 05:38:18,013 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 znode expired, triggering replicatorRemoved event 2018-05-02 05:38:18,014 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:18,518 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:18,535 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:18,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:38:18,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 28608f50f9f828e7d3ab571a72b0d5f3, NAME => 'test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:38:18,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 05:38:18,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AuthenticationService 2018-05-02 05:38:18,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 05:38:18,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,536 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:18,536 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=SecureBulkLoadService 2018-05-02 05:38:18,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,537 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:18,537 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:18,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:18,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 05:38:18,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AccessControlService 2018-05-02 05:38:18,537 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,537 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:18,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,537 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:18,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:38:18,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 05:38:18,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:18,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:18,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,538 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:18,553 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 05:38:18,553 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 05:38:18,554 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,555 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,556 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:38:18,557 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:38:18,558 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:18,558 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:18,588 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf/8206d33252364d01b7ddcb8a35cf4b14 2018-05-02 05:38:18,588 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,589 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 05:38:18,589 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:18,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 05:38:18,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:38:18,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12446.seqid, newMaxSeqId=12446, maxSeqId=12445 2018-05-02 05:38:18,662 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12010.seqid, newMaxSeqId=12010, maxSeqId=12009 2018-05-02 05:38:18,665 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12446 2018-05-02 05:38:18,672 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:18,674 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 28608f50f9f828e7d3ab571a72b0d5f3; next sequenceid=12010 2018-05-02 05:38:18,676 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:18,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:18,680 INFO [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:18,683 DEBUG [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:18,683 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:21,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:36.005 minutes, events=3, succcessCount=3, totalEvents=662, totalSuccessCount=662 2018-05-02 05:38:23,538 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:23,539 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:23,544 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:24,050 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:24,339 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:24,340 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:38:24,411 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:38:24,411 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:24,411 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:24,419 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:24,421 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:24,421 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:48,018 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:48,031 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:38:48,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:38:48,032 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:48,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:38:48,032 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:48,032 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:48,032 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:48,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:38:48,033 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:48,033 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:48,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:38:48,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:48,033 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:48,049 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:38:48,049 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:38:48,050 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:48,051 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:48,083 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:38:48,083 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:48,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:38:48,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12065.seqid, newMaxSeqId=12065, maxSeqId=12064 2018-05-02 05:38:48,140 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12065 2018-05-02 05:38:48,145 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:48,148 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:38:48,148 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:48,337 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=2, succcessCount=1, totalEvents=1886, totalSuccessCount=663 2018-05-02 05:38:50,065 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:50,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:38:50,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 05:38:50,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:50,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 05:38:50,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:50,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:50,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:50,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 05:38:50,080 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:50,080 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:50,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:38:50,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:50,080 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:50,094 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:38:50,094 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:38:50,095 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:50,096 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:50,117 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 05:38:50,118 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:50,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:38:50,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11456.seqid, newMaxSeqId=11456, maxSeqId=11455 2018-05-02 05:38:50,170 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11456 2018-05-02 05:38:50,173 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:50,180 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:38:50,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:51,905 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:52,302 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:52,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:38:52,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:38:52,313 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:52,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:38:52,313 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:52,313 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:52,313 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:52,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:38:52,314 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:52,314 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:52,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:38:52,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:52,314 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:52,328 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:38:52,328 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:38:52,329 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:52,329 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:52,353 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:38:52,353 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:52,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:38:52,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13458.seqid, newMaxSeqId=13458, maxSeqId=13457 2018-05-02 05:38:52,392 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13458 2018-05-02 05:38:52,394 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:52,397 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:38:52,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:38:53,033 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:53,034 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:53,037 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:53,542 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:53,861 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:53,862 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:38:53,930 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:38:53,931 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:53,931 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:53,936 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:53,938 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:53,938 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844." 2018-05-02 05:38:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close 931a5308337d39ab8fcac37d3a5e5844, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606. Requested from /172.27.59.154 2018-05-02 05:38:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd." 2018-05-02 05:38:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close dc953453430fbf031584084fad7c31bd, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:54,081 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:54,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 05:38:54,082 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:54,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,083 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing dc953453430fbf031584084fad7c31bd, disabling compactions & flushes 2018-05-02 05:38:54,083 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:38:54,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12448.seqid, newMaxSeqId=12448, maxSeqId=12446 2018-05-02 05:38:54,102 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12677.seqid, newMaxSeqId=12677, maxSeqId=12675 2018-05-02 05:38:54,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:54,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:54,104 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:54,104 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,104 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 931a5308337d39ab8fcac37d3a5e5844 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 record at close sequenceid=12446 2018-05-02 05:38:54,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:54,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:54,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:54,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:38:54,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding dc953453430fbf031584084fad7c31bd move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12675 2018-05-02 05:38:54,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:38:54,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 05:38:54,800 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81." 2018-05-02 05:38:54,801 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close a0792481dc7d859b1b63b04bf9adad81, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:54,801 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3." 2018-05-02 05:38:54,801 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close ce3059196e012fe2ffadcb5d2b348ce3, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:54,801 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:54,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 05:38:54,801 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:54,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:54,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 05:38:54,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:54,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.87 MB memstore heap size=2.81 MB 2018-05-02 05:38:54,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12799.seqid, newMaxSeqId=12799, maxSeqId=12797 2018-05-02 05:38:54,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:54,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:54,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:54,822 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:54,822 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding ce3059196e012fe2ffadcb5d2b348ce3 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=12797 2018-05-02 05:38:54,825 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:55,031 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.87 MB at sequenceid=11946 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/.tmp/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 05:38:55,059 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/.tmp/test_cf/273e08be6b9245749007d7ffc22c666d as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 05:38:55,089 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d, entries=12995, sequenceid=11946, filesize=2.0 M 2018-05-02 05:38:55,091 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.87 MB/1964632, heap size ~2.81 MB/2949488, currentsize=0 B/0 for a0792481dc7d859b1b63b04bf9adad81 in 289ms, sequenceid=11946, compaction requested=false 2018-05-02 05:38:55,126 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11949.seqid, newMaxSeqId=11949, maxSeqId=5 2018-05-02 05:38:55,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:55,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:55,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:55,134 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,134 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding a0792481dc7d859b1b63b04bf9adad81 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=11946 2018-05-02 05:38:55,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,918 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c." 2018-05-02 05:38:55,918 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close 84c55bda386b9aa62a8b4df75ca9b38c, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:55,918 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5." 2018-05-02 05:38:55,918 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close ffde9f4a59ab08d4830f3b671f736ad5, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:55,918 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:55,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 05:38:55,919 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:55,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:55,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 05:38:55,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:55,919 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.86 MB memstore heap size=2.79 MB 2018-05-02 05:38:55,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11985.seqid, newMaxSeqId=11985, maxSeqId=11983 2018-05-02 05:38:55,947 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:55,947 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:55,947 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:55,947 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:55,947 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding ffde9f4a59ab08d4830f3b671f736ad5 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=11983 2018-05-02 05:38:55,950 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:56,143 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.86 MB at sequenceid=11873 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/.tmp/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 05:38:56,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/.tmp/test_cf/e85dca4d9952403a8e861bb27c95db92 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 05:38:56,184 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92, entries=12900, sequenceid=11873, filesize=1.9 M 2018-05-02 05:38:56,186 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~1.86 MB/1953623, heap size ~2.80 MB/2930888, currentsize=0 B/0 for 84c55bda386b9aa62a8b4df75ca9b38c in 267ms, sequenceid=11873, compaction requested=false 2018-05-02 05:38:56,228 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11876.seqid, newMaxSeqId=11876, maxSeqId=5 2018-05-02 05:38:56,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:56,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:56,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:56,233 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:56,233 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 84c55bda386b9aa62a8b4df75ca9b38c move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=11873 2018-05-02 05:38:56,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:57,036 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6." 2018-05-02 05:38:57,036 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close 735f841820ff0baa687bc402b169f4a6, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474. Requested from /172.27.59.154 2018-05-02 05:38:57,036 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3." 2018-05-02 05:38:57,036 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Close 28608f50f9f828e7d3ab571a72b0d5f3, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:57,036 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:57,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 05:38:57,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,037 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:57,037 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.92 MB memstore heap size=2.88 MB 2018-05-02 05:38:57,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 28608f50f9f828e7d3ab571a72b0d5f3, disabling compactions & flushes 2018-05-02 05:38:57,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:57,066 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12012.seqid, newMaxSeqId=12012, maxSeqId=12010 2018-05-02 05:38:57,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:57,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:57,071 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:57,071 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:57,071 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 28608f50f9f828e7d3ab571a72b0d5f3 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12010 2018-05-02 05:38:57,074 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 05:38:57,129 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.92 MB at sequenceid=12226 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/.tmp/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 05:38:57,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/.tmp/test_cf/701b265951a9459fbb2a9068086da9e9 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 05:38:57,171 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9, entries=13295, sequenceid=12226, filesize=2.0 M 2018-05-02 05:38:57,174 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.92 MB/2011251, heap size ~2.88 MB/3018640, currentsize=0 B/0 for 735f841820ff0baa687bc402b169f4a6 in 137ms, sequenceid=12226, compaction requested=false 2018-05-02 05:38:57,193 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12229.seqid, newMaxSeqId=12229, maxSeqId=5 2018-05-02 05:38:57,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:57,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:57,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:57,198 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,198 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 735f841820ff0baa687bc402b169f4a6 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 record at close sequenceid=12226 2018-05-02 05:38:57,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,956 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:57,957 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:57,960 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:58,463 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:58,641 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:58,642 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:38:58,711 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:38:58,711 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:58,712 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:58,716 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:58,718 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:58,718 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:59,658 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 05:38:59,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 05:38:59,677 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:59,677 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 05:38:59,678 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:59,678 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:59,678 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:59,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 05:38:59,678 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:59,678 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:59,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:38:59,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,679 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:59,690 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:38:59,690 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:38:59,692 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=165.39 KB, freeSize=204.64 MB, maxSize=204.80 MB, heapSize=165.39 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:59,693 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:59,717 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 05:38:59,718 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:59,723 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:38:59,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13398.seqid, newMaxSeqId=13398, maxSeqId=13397 2018-05-02 05:38:59,748 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13398 2018-05-02 05:38:59,751 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,754 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:04,678 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:39:04,682 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:39:04,685 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:39:05,188 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:39:05,476 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:39:05,477 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:39:05,555 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:39:05,555 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:39:05,555 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:39:05,561 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:39:05,563 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:39:05,563 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started Wed May 2 05:39:43 UTC 2018 Terminating regionserver 2018-05-02 05:39:43,841 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:39:43,841 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:39:43,841 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:39:43,842 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:39:43,842 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:39:43,842 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:39:43,842 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:39:43,842 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:39:43,842 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:39:43,842 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:39:43,842 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:39:43,842 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:39:43,842 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:39:43,842 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:39:43,842 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:39:43,842 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:39:43,843 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:39:43,842 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:39:43,843 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502' ***** 2018-05-02 05:39:43,843 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:39:43,843 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:22.507 minutes, events=11, succcessCount=11, totalEvents=673, totalSuccessCount=673 2018-05-02 05:39:43,844 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:39:43,844 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=55.507 seconds, events=20, succcessCount=10, totalEvents=1906, totalSuccessCount=673 2018-05-02 05:39:43,844 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:39:43,845 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:43,845 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:39:43,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:39:43,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:39:43,845 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:39:43,845 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 exiting 2018-05-02 05:39:43,863 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:39:43,869 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:39:43,869 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:39:43,869 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:39:43,871 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:39:43,872 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:39:43,872 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:39:43,872 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:39:43,872 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:39:43,872 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,873 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,873 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,873 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 05:39:43,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:43,874 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 05:39:43,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:43,874 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,874 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 05:39:43,875 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:39:43,875 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,875 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,876 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,876 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,876 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,876 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:43,876 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:39:43,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x628fd49f to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:39:43,877 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:39:43,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:39:43,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:39:43,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:39:43,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,878 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 14 regions to close 2018-05-02 05:39:43,878 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,878 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 05:39:43,878 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 05:39:43,878 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=92.76 KB memstore heap size=135.44 KB 2018-05-02 05:39:43,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12779.seqid, newMaxSeqId=12779, maxSeqId=12777 2018-05-02 05:39:43,949 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12234.seqid, newMaxSeqId=12234, maxSeqId=12232 2018-05-02 05:39:43,949 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12538.seqid, newMaxSeqId=12538, maxSeqId=12536 2018-05-02 05:39:43,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:43,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:43,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:43,955 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:43,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 05:39:43,956 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,957 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 05:39:43,957 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:43,959 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:43,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:43,960 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:43,960 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,960 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:39:43,961 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:43,961 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 05:39:43,961 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:39:43,961 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 05:39:43,961 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.02 MB memstore heap size=3.03 MB 2018-05-02 05:39:43,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:39:44,007 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=92.76 KB at sequenceid=796 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/719732a22ccb4e58aef5e4ab7c3fb0ba 2018-05-02 05:39:44,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11458.seqid, newMaxSeqId=11458, maxSeqId=11456 2018-05-02 05:39:44,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13460.seqid, newMaxSeqId=13460, maxSeqId=13458 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,043 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:39:44,043 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:39:44,044 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,044 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:44,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:44,055 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/719732a22ccb4e58aef5e4ab7c3fb0ba as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba 2018-05-02 05:39:44,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12067.seqid, newMaxSeqId=12067, maxSeqId=12065 2018-05-02 05:39:44,140 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba, entries=460, sequenceid=796, filesize=81.2 K 2018-05-02 05:39:44,142 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~92.76 KB/94984, heap size ~135.65 KB/138904, currentsize=0 B/0 for 1588230740 in 264ms, sequenceid=796, compaction requested=false 2018-05-02 05:39:44,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,151 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:44,151 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:44,151 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,151 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 05:39:44,152 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:44,152 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.01 MB memstore heap size=3.02 MB 2018-05-02 05:39:44,157 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12149.seqid, newMaxSeqId=12149, maxSeqId=12147 2018-05-02 05:39:44,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:44,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:44,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 05:39:44,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:39:44,167 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=10.53 KB memstore heap size=11.86 KB 2018-05-02 05:39:44,192 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/799.seqid, newMaxSeqId=799, maxSeqId=627 2018-05-02 05:39:44,210 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,210 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:39:44,210 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,210 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,211 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 05:39:44,211 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 05:39:44,213 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:39:44,264 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=10.53 KB at sequenceid=44 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp/dt/1f1dc7f6656441098dc6f2874fb92c0d 2018-05-02 05:39:44,325 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp/dt/1f1dc7f6656441098dc6f2874fb92c0d as hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/1f1dc7f6656441098dc6f2874fb92c0d 2018-05-02 05:39:44,367 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/1f1dc7f6656441098dc6f2874fb92c0d, entries=18, sequenceid=44, filesize=6.0 K 2018-05-02 05:39:44,369 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~10.53 KB/10780, heap size ~12.07 KB/12360, currentsize=0 B/0 for 8dc6fd2022c2fdf8c065fbd16cadaaca in 202ms, sequenceid=44, compaction requested=true 2018-05-02 05:39:44,401 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.01 MB at sequenceid=12837 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/.tmp/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 05:39:44,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/47.seqid, newMaxSeqId=47, maxSeqId=39 2018-05-02 05:39:44,410 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,410 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,410 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,411 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:39:44,411 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:39:44,411 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,411 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 05:39:44,411 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:44,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/.tmp/test_cf/6120c78c262141868de3a5506d72ea0b as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 05:39:44,453 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12189.seqid, newMaxSeqId=12189, maxSeqId=12187 2018-05-02 05:39:44,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,467 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:44,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:39:44,467 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 05:39:44,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:39:44,495 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b, entries=13928, sequenceid=12837, filesize=2.1 M 2018-05-02 05:39:44,497 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.01 MB/2110942, heap size ~3.02 MB/3166480, currentsize=0 B/0 for e75a388bc2011feed75bdc1a0e99a9a9 in 345ms, sequenceid=12837, compaction requested=false 2018-05-02 05:39:44,507 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11349.seqid, newMaxSeqId=11349, maxSeqId=11347 2018-05-02 05:39:44,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,517 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.02 MB at sequenceid=12879 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/.tmp/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 05:39:44,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,517 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:39:44,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:39:44,518 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:44,519 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 05:39:44,519 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:44,532 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12840.seqid, newMaxSeqId=12840, maxSeqId=5 2018-05-02 05:39:44,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,543 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:44,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:44,546 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/.tmp/test_cf/dae192f9264e44f1a0666db38941e7af as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 05:39:44,547 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13400.seqid, newMaxSeqId=13400, maxSeqId=13398 2018-05-02 05:39:44,554 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,554 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,554 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,554 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:44,554 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:44,579 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af, entries=13988, sequenceid=12879, filesize=2.1 M 2018-05-02 05:39:44,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~2.02 MB/2119007, heap size ~3.03 MB/3178616, currentsize=0 B/0 for a0620fc83de532a37f6a9bb8f99cc6c4 in 621ms, sequenceid=12879, compaction requested=false 2018-05-02 05:39:44,605 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12882.seqid, newMaxSeqId=12882, maxSeqId=5 2018-05-02 05:39:44,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:39:44,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:39:44,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:39:44,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:39:44,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:39:44,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502; all regions closed. 2018-05-02 05:39:44,679 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:44,716 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:39:44,716 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502.meta:.meta(num 1525239403417) 2018-05-02 05:39:44,716 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:44,745 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:39:44,745 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525238558502:(num 1525238572271) 2018-05-02 05:39:44,745 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:39:44,746 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 05:39:44,748 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:39:44,749 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:39:44,755 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 05:39:44,755 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:39:44,755 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:39:44,797 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:44,798 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00b7, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:39:44,800 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:39:44,801 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c00b7 closed 2018-05-02 05:39:44,801 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502; zookeeper connection closed. 2018-05-02 05:39:44,801 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:39:44,812 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:40:06 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:40:08,738 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:40:08,741 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:40:08,741 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:40:08,741 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:40:08,741 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:40:09,295 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:40:09,295 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:40:09,295 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:40:09,295 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:40:09,297 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:40:09,298 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020540 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:40:09,299 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:40:09,300 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:40:09,300 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:40:09,300 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:40:09,300 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:40:09,301 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:40:09,302 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020540 2018-05-02 05:40:09,302 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:40:09,302 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:40:09,302 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:40:09,303 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:40:09,306 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:40:09,307 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020540, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:40:09,509 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:40:10,047 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:40:10,138 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:40:10,821 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:40:10,830 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:40:11,520 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:40:11,520 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:40:11,520 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:40:11,576 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:40:11,733 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:40:11,733 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:40:11,763 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:40:12,088 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 05:40:12,111 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:40:12,114 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:40:12,115 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:40:12,115 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:40:12,115 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:40:12,116 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:40:12,299 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:40:12,514 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:40:12,529 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:40:12,631 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 05:40:12,754 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:40:12,757 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:40:12,759 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:40:12,771 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:40:12,773 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:40:12,778 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:40:14,271 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:40:14,287 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:40:14,361 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:40:14,368 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:40:14,369 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:40:14,370 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:40:14,406 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:40:14,408 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:40:14,414 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:40:14,421 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:40:14,421 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:40:14 UTC 2018 2018-05-02 05:40:14,421 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:40:14 UTC 2018 2018-05-02 05:40:14,422 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:28:28 UTC 2018 2018-05-02 05:40:14,427 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:40:14,435 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00ca, negotiated timeout = 90000 2018-05-02 05:40:14,438 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:40:14,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca connected 2018-05-02 05:40:14,477 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:40:14,549 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:40:14,549 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:40:14,549 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:40:14,549 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:40:14,556 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:40:14,591 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:40:14,594 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:40:14,594 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:40:14,599 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:40:14,602 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:40:14,645 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:40:14,645 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:40:14,645 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:40:14,679 INFO [main] util.log: Logging initialized @7054ms 2018-05-02 05:40:14,787 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:40:14,804 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:40:14,805 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:40:14,808 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:40:14,808 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:40:14,808 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:40:14,846 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:40:14,848 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:40:14,902 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:40:14,903 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:40:15,092 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:40:15,097 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:40:15,111 INFO [main] server.AbstractConnector: Started ServerConnector@2c837bb5{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:40:15,111 INFO [main] server.Server: Started @7486ms 2018-05-02 05:40:15,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:40:15,146 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:40:15,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:40:15,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:40:15,178 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:40:15,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x0f880892 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:40:15,216 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/887427401@71e799b1 2018-05-02 05:40:15,219 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:40:15,221 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:40:15,221 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:40:15,225 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390081, negotiated timeout = 90000 2018-05-02 05:40:15,266 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39206e47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:40:15,270 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2123cad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 05:40:15,281 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 05:40:15,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:40:15,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:40:15,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:40:15,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:40:15,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:40:15,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:40:15,327 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:40:15,328 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:40:15,495 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:40:15,497 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:40:15,501 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:40:15,501 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:40:15,505 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:40:15,505 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:40:15,544 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:40:15,545 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:40:15,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:40:15,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:40:15,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:40:15,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:40:15,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:40:15,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:40:15,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:40:15,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:40:15,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:40:15,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:40:15,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:40:15,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:40:15,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:40:15,598 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:40:15,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:40:15,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:40:15,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:40:15,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:40:15,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:40:15,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:40:15,628 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:40:15,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:40:15,633 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:40:15,633 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:40:15,633 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:40:15,633 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:40:15,634 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:40:15,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:40:15,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:40:15,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:40:15,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:40:15,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:40:15,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:40:15,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:40:15,639 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:40:15,644 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:40:15,644 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:40:15,911 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:40:16,321 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:40:18,012 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:40:18,127 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:40:18,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:40:18,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:40:18,132 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:40:18,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:40:18,147 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525238791399 with port=16020, startcode=1525239609353 2018-05-02 05:40:18,262 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:40:18,262 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:40:18,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:40:18,371 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:40:18,386 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:40:18,415 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:40:18,419 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:40:18,420 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:40:18,421 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:40:18,422 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:40:18,480 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:40:18,480 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:40:18,480 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:40:18,559 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:40:18,584 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:40:18,922 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:40:18,970 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:40:19,065 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:40:19,080 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:40:19,085 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:40:19,129 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:40:19,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:40:19,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:40:19,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:40:19,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:40:19,174 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:40:19,175 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:40:19,175 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:40:19,177 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:40:19,356 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 starting 2018-05-02 05:40:19,364 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:40:19,386 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:40:19,402 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:40:19,411 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:40:19,418 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:40:19,500 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353] other RSs: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353] 2018-05-02 05:40:19,585 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x1631f08b26c00ca 2018-05-02 05:40:19,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:40:19,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:40:19,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353' 2018-05-02 05:40:19,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:40:19,588 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353' 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:40:19,589 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:40:19,590 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:40:19,591 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:40:19,591 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:40:21,761 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:40:21,762 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:40:22,696 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525239609353, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:40:23,361 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 569 ms, current pipeline: [] 2018-05-02 05:40:23,362 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525239609353.1525239622696 2018-05-02 05:40:23,363 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:41:12,100 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,101 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,104 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:41:12,109 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:41:12,109 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:41:12,110 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:41:12,110 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,110 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 05:41:12,110 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/4 2018-05-02 05:41:12,110 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,113 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:41:12,116 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 znode expired, triggering replicatorRemoved event 2018-05-02 05:41:12,121 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:41:12,569 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:41:12,576 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:41:12,576 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:41:12,589 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:41:12,606 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:41:12,606 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:41:12,608 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:41:12,608 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:41:12,609 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:41:12,803 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:14,154 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:14,178 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:14,179 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:14,230 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:14,239 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 05:41:14,239 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 05:41:14,239 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:41:14,241 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 05:41:14,250 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:14,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:41:14,455 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 05:41:14,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:41:14,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 05:41:14,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 05:41:14,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 05:41:14,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 05:41:14,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 05:41:14,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,593 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 05:41:14,596 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,596 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 05:41:14,597 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,597 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 05:41:14,598 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,598 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 05:41:14,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:41:14,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 05:41:14,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 05:41:14,601 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,601 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,601 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 05:41:14,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:41:14,601 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,602 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,602 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,601 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 05:41:14,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 05:41:14,603 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,603 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,603 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 05:41:14,603 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,604 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:41:14,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:41:14,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:14,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 05:41:14,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:14,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:41:14,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:14,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:14,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:41:14,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:14,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:41:14,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:14,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,812 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:41:14,812 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 05:41:14,813 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:41:14,813 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:41:14,813 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:41:14,812 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:41:14,813 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 05:41:14,813 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:41:14,815 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:41:14,815 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:41:14,816 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:41:14,816 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 05:41:14,849 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,851 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,851 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,849 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,854 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,867 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,868 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,868 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,868 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,871 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,872 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,873 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:15,147 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 05:41:15,147 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:41:15,147 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 05:41:15,147 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 05:41:15,148 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 05:41:15,149 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 05:41:15,152 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,152 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,152 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,152 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,153 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,153 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:15,206 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:41:15,215 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 05:41:15,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:41:15,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 05:41:15,223 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 05:41:15,225 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:41:15,355 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892] zookeeper.ZooKeeper: Session: 0x2631f08d9390081 closed 2018-05-02 05:41:15,355 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x0f880892-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:41:15,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13217.seqid, newMaxSeqId=13217, maxSeqId=13216 2018-05-02 05:41:15,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12786.seqid, newMaxSeqId=12786, maxSeqId=12785 2018-05-02 05:41:15,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12542.seqid, newMaxSeqId=12542, maxSeqId=12541 2018-05-02 05:41:15,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12344.seqid, newMaxSeqId=12344, maxSeqId=12343 2018-05-02 05:41:15,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12589.seqid, newMaxSeqId=12589, maxSeqId=12588 2018-05-02 05:41:15,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12193.seqid, newMaxSeqId=12193, maxSeqId=12192 2018-05-02 05:41:15,390 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13217 2018-05-02 05:41:15,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=12344 2018-05-02 05:41:15,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12542 2018-05-02 05:41:15,395 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12786 2018-05-02 05:41:15,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12193 2018-05-02 05:41:15,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12589 2018-05-02 05:41:15,456 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:15,471 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:15,474 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:15,477 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:15,478 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:15,478 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:15,493 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:41:15,494 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:41:15,494 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 05:41:15,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,495 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:41:15,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,495 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:41:15,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,496 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:41:15,496 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:41:15,646 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.019 minutes, events=2, totalEvents=2 2018-05-02 05:41:15,673 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@203fc2ee 2018-05-02 05:41:15,674 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:41:15,675 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:41:15,676 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:41:15,679 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390082, negotiated timeout = 10000 2018-05-02 05:41:15,733 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:41:15,739 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:41:19,065 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:41:19,065 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:41:19,639 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:41:19,640 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:41:19,641 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:41:20,164 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:41:20,667 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:41:20,668 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:41:20,819 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:41:20,819 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:41:20,819 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:41:20,835 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:41:20,860 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:41:20,860 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:41:21,753 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:41:21,753 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:41:21,754 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:41:21,754 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:41:21,755 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:41:21,755 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:41:52,274 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:42:15,654 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=2, succcessCount=2, totalEvents=4, totalSuccessCount=2 2018-05-02 05:43:20,873 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:22,127 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:23,877 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:23,878 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:24,883 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:25,889 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:26,894 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:27,312 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:30,499 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:43:30,499 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,499 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:43:30,502 DEBUG [RS-EventLoopGroup-1-6] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,509 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:43:30,538 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:43:30,539 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:43:30,540 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:43:30,540 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:43:30,541 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:44:08,907 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:44:08,909 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:08,909 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:08,912 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:08,915 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:08,915 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:08,916 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:08,917 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:08,917 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:08,921 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:08,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 05:44:08,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 05:44:08,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:08,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 05:44:08,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:08,951 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:08,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:08,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 05:44:08,952 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:08,952 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:08,952 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:44:08,952 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:08,953 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:08,976 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:44:08,976 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:44:08,978 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:08,979 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:09,043 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 05:44:09,043 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:09,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:44:09,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13402.seqid, newMaxSeqId=13402, maxSeqId=13401 2018-05-02 05:44:09,143 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13402 2018-05-02 05:44:09,147 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:09,219 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:09,219 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:10,089 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:10,091 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 05:44:10,455 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,458 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 znode expired, triggering replicatorRemoved event 2018-05-02 05:44:10,459 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:44:12,662 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:57.013 minutes, events=2, succcessCount=2, totalEvents=2, totalSuccessCount=2 2018-05-02 05:44:13,953 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:44:13,954 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:44:13,958 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:44:14,467 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:44:14,594 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:14,874 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:44:14,874 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:44:14,982 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:44:14,982 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:44:14,983 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:44:14,990 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:44:14,998 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:44:14,998 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:44:15,662 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=2, succcessCount=1, totalEvents=6, totalSuccessCount=3 2018-05-02 05:44:16,871 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:16,872 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 05:44:17,443 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:18,069 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:18,088 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:18,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:44:18,089 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:18,089 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:18,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:44:18,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:44:18,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:44:18,091 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,091 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:44:18,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:44:18,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:44:18,091 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,091 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,091 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:44:18,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,092 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:44:18,092 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:18,092 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,092 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:44:18,092 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:18,093 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,093 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:44:18,093 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:44:18,094 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:44:18,094 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,094 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,094 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:44:18,094 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,094 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:44:18,094 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:18,095 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,116 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:44:18,116 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:44:18,118 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,118 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,119 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:18,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:44:18,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 05:44:18,121 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:44:18,121 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:44:18,121 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 05:44:18,122 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,122 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,122 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,122 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:44:18,122 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:44:18,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 05:44:18,122 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:44:18,122 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 05:44:18,123 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:18,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 05:44:18,123 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:18,123 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:18,123 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:18,123 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 05:44:18,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:18,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:44:18,131 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:18,132 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:18,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:44:18,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:18,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:18,135 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,137 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,256 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:44:18,256 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:44:18,257 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,258 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,270 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:44:18,270 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:44:18,271 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:18,272 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:18,284 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:44:18,285 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,292 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:44:18,292 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:44:18,330 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:44:18,332 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:44:18,332 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:44:18,376 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 05:44:18,376 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:44:18,402 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 05:44:18,406 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:18,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12069.seqid, newMaxSeqId=12069, maxSeqId=12068 2018-05-02 05:44:18,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12989.seqid, newMaxSeqId=12989, maxSeqId=12988 2018-05-02 05:44:18,452 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:44:18,460 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12989 2018-05-02 05:44:18,463 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12069 2018-05-02 05:44:18,470 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:18,472 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:18,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12789.seqid, newMaxSeqId=12789, maxSeqId=12788 2018-05-02 05:44:18,484 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:18,485 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:18,485 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:18,485 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:18,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12789 2018-05-02 05:44:18,511 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:18,520 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:18,520 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:18,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12842.seqid, newMaxSeqId=12842, maxSeqId=12841 2018-05-02 05:44:18,580 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=12842 2018-05-02 05:44:18,586 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12745.seqid, newMaxSeqId=12745, maxSeqId=12744 2018-05-02 05:44:18,587 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:18,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=12745 2018-05-02 05:44:18,609 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:18,609 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:18,616 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:18,629 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:18,629 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:23,092 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:44:23,093 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:44:23,099 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:44:23,607 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:44:23,961 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:44:23,962 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:44:24,090 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:44:24,090 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:44:24,090 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:44:24,097 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:44:24,099 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:44:24,099 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:44:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 05:44:52,056 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:44:52,058 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:52,058 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,061 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:52,066 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,066 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:52,068 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:52,068 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:52,068 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:52,264 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 05:44:52,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 51119cebc42546d1c9f2590eec5a49b3, NAME => 'test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 05:44:52,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AuthenticationService 2018-05-02 05:44:52,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=SecureBulkLoadService 2018-05-02 05:44:52,266 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,266 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AccessControlService 2018-05-02 05:44:52,267 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,267 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51119cebc42546d1c9f2590eec5a49b3 2018-05-02 05:44:52,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 05:44:52,268 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,277 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 05:44:52,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 05:44:52,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 05:44:52,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,278 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 05:44:52,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 05:44:52,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 3ea52812fafc49b1651e26e1bd43ec97, NAME => 'test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 05:44:52,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 05:44:52,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AuthenticationService 2018-05-02 05:44:52,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=SecureBulkLoadService 2018-05-02 05:44:52,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 05:44:52,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 05:44:52,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AccessControlService 2018-05-02 05:44:52,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 05:44:52,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 05:44:52,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 9c4d77e622ed44a126e39f057f044750, NAME => 'test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 05:44:52,283 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 05:44:52,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AuthenticationService 2018-05-02 05:44:52,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=SecureBulkLoadService 2018-05-02 05:44:52,284 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,284 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AccessControlService 2018-05-02 05:44:52,284 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 9c4d77e622ed44a126e39f057f044750 2018-05-02 05:44:52,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 05:44:52,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,287 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 05:44:52,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 89df5caac424c7424fede4183c6dce19, NAME => 'test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 05:44:52,288 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 05:44:52,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 05:44:52,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AuthenticationService 2018-05-02 05:44:52,289 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 05:44:52,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 24479666cac01319b99b1d0e11484b5c, NAME => 'test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 05:44:52,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=SecureBulkLoadService 2018-05-02 05:44:52,289 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,289 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 05:44:52,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AccessControlService 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AuthenticationService 2018-05-02 05:44:52,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 05:44:52,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=SecureBulkLoadService 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 89df5caac424c7424fede4183c6dce19 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 05:44:52,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 05:44:52,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 05:44:52,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,290 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 05:44:52,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AccessControlService 2018-05-02 05:44:52,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => 385c8f00672f754fa0d7448f5ac543fa, NAME => 'test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 05:44:52,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 05:44:52,293 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 05:44:52,293 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,293 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 05:44:52,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 24479666cac01319b99b1d0e11484b5c 2018-05-02 05:44:52,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 05:44:52,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 05:44:52,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 05:44:52,294 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,294 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 05:44:52,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 05:44:52,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 05:44:52,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 05:44:52,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 05:44:52,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 05:44:52,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,296 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 05:44:52,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 05:44:52,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AuthenticationService 2018-05-02 05:44:52,297 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:44:52,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=SecureBulkLoadService 2018-05-02 05:44:52,297 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:44:52,297 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:44:52,297 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:44:52,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AccessControlService 2018-05-02 05:44:52,298 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:44:52,298 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:44:52,298 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 385c8f00672f754fa0d7448f5ac543fa 2018-05-02 05:44:52,298 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 05:44:52,298 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:52,334 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 05:44:52,334 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 05:44:52,335 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,336 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,352 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,365 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3 2018-05-02 05:44:52,378 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 05:44:52,378 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 05:44:52,379 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,380 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,390 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,390 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 05:44:52,390 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 05:44:52,391 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,392 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 05:44:52,392 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 05:44:52,392 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,392 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,395 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 05:44:52,401 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,401 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 05:44:52,401 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 05:44:52,404 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,405 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,405 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 05:44:52,405 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 05:44:52,406 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,406 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,406 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,408 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c 2018-05-02 05:44:52,410 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 05:44:52,410 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 05:44:52,410 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 05:44:52,411 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,412 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,413 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 05:44:52,413 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 05:44:52,413 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 05:44:52,413 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 05:44:52,414 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,414 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,415 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,415 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,416 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,417 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,417 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 05:44:52,417 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 05:44:52,418 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:44:52,418 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:44:52,419 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 05:44:52,439 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,440 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,440 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:44:52,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19 2018-05-02 05:44:52,455 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750 2018-05-02 05:44:52,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 05:44:52,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa 2018-05-02 05:44:52,468 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 05:44:52,474 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,474 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 51119cebc42546d1c9f2590eec5a49b3; next sequenceid=2 2018-05-02 05:44:52,478 INFO [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 05:44:52,487 DEBUG [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 05:44:52,487 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,565 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 3ea52812fafc49b1651e26e1bd43ec97; next sequenceid=2 2018-05-02 05:44:52,566 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,566 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 24479666cac01319b99b1d0e11484b5c; next sequenceid=2 2018-05-02 05:44:52,569 INFO [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 05:44:52,569 INFO [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 05:44:52,580 DEBUG [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 05:44:52,580 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,584 DEBUG [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 05:44:52,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=2 2018-05-02 05:44:52,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 89df5caac424c7424fede4183c6dce19; next sequenceid=2 2018-05-02 05:44:52,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,615 INFO [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 05:44:52,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=2 2018-05-02 05:44:52,617 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 05:44:52,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,622 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened 385c8f00672f754fa0d7448f5ac543fa; next sequenceid=2 2018-05-02 05:44:52,623 DEBUG [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 05:44:52,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,625 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 05:44:52,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,643 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 05:44:52,643 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=2 2018-05-02 05:44:52,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,644 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 9c4d77e622ed44a126e39f057f044750; next sequenceid=2 2018-05-02 05:44:52,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:44:52,644 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=2 2018-05-02 05:44:52,645 INFO [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 05:44:52,648 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 05:44:52,648 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 05:44:52,648 INFO [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 05:44:52,650 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 05:44:52,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,658 DEBUG [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 05:44:52,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,658 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 05:44:52,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,659 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 05:44:52,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:52,660 DEBUG [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 05:44:52,660 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:44:55,082 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:44:57,267 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:44:57,269 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:44:57,271 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:44:57,774 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:44:58,152 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:44:58,152 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:44:58,247 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:44:58,247 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:44:58,247 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:44:58,253 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:44:58,256 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:44:58,256 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:45:12,769 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:45:15,672 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.010 minutes, events=6, succcessCount=3, totalEvents=12, totalSuccessCount=6 2018-05-02 05:45:19,418 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:45:19,419 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:45:59,365 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:45:59,365 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,366 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:45:59,372 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:45:59,412 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:45:59,413 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:00,072 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:46:00,072 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:00,072 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:46:00,075 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:00,077 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:46:00,080 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:00,682 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:48.020 minutes, events=4, succcessCount=4, totalEvents=6, totalSuccessCount=6 2018-05-02 05:46:01,141 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:46:01,141 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:01,142 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:46:01,143 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:01,144 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:46:01,145 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:08,113 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 127 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:46:08,828 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:46:08,828 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:08,828 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:46:08,831 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:46:08,833 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:46:08,834 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:46:16,103 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.431 minutes, events=182120, succcessCount=11010, totalEvents=182132, totalSuccessCount=11016 2018-05-02 05:46:19,637 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:46:19,638 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:46:19,641 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:46:20,145 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:46:20,407 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:46:20,408 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:46:20,470 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:46:20,470 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:46:20,470 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:46:20,475 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:46:20,478 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:46:20,479 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:46:41,724 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 321 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK]] 2018-05-02 05:46:59,958 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:46:59,964 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=23.5 M 2018-05-02 05:46:59,966 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:46:59,977 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=11.19 MB memstore heap size=23.51 MB 2018-05-02 05:47:00,826 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.144 minutes, events=65412, succcessCount=65412, totalEvents=65418, totalSuccessCount=65418 2018-05-02 05:47:01,204 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=11.19 MB at sequenceid=280 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/.tmp/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 05:47:01,293 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/.tmp/f1/23f180c1403c423b8d56e773059b77f3 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 05:47:01,356 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3, entries=181687, sequenceid=280, filesize=11.0 M 2018-05-02 05:47:01,385 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~11.19 MB/11732728, heap size ~23.51 MB/24649056, currentsize=300.89 KB/308112 for 51119cebc42546d1c9f2590eec5a49b3 in 1409ms, sequenceid=280, compaction requested=false 2018-05-02 05:47:06,932 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:06,933 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=205.0 MTotal Memstore Off-Heap size=0, Region memstore size=26.1 M 2018-05-02 05:47:06,933 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:06,935 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=12.45 MB memstore heap size=26.13 MB 2018-05-02 05:47:07,723 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=12.45 MB at sequenceid=312 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/.tmp/f1/0acb18db6bda4706bbcda3af69f23a7f 2018-05-02 05:47:07,752 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/.tmp/f1/0acb18db6bda4706bbcda3af69f23a7f as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/0acb18db6bda4706bbcda3af69f23a7f 2018-05-02 05:47:07,797 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/0acb18db6bda4706bbcda3af69f23a7f, entries=201953, sequenceid=312, filesize=12.2 M 2018-05-02 05:47:07,803 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~12.45 MB/13053208, heap size ~26.13 MB/27398512, currentsize=214.92 KB/220080 for 24479666cac01319b99b1d0e11484b5c in 867ms, sequenceid=312, compaction requested=false 2018-05-02 05:47:13,091 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: WAL roll requested 2018-05-02 05:47:13,206 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] wal.AbstractFSWAL: Rolled WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525239609353.1525239622696 with entries=3089, filesize=128.24 MB; new WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525239609353.1525240033093 2018-05-02 05:47:13,206 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:47:13,774 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:13,785 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=28.8 M 2018-05-02 05:47:13,786 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:13,786 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.72 MB memstore heap size=28.77 MB 2018-05-02 05:47:14,468 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.72 MB at sequenceid=348 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/.tmp/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 05:47:14,529 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/.tmp/f1/df553232e0f34ff59749e1f4f7761033 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 05:47:14,579 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033, entries=222335, sequenceid=348, filesize=13.5 M 2018-05-02 05:47:14,585 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~13.72 MB/14383120, heap size ~28.77 MB/30163696, currentsize=153.52 KB/157200 for 685781049fdcc89efe3561b69e4d3810 in 799ms, sequenceid=348, compaction requested=false 2018-05-02 05:47:16,316 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.213 minutes, events=971579, succcessCount=63794, totalEvents=1153711, totalSuccessCount=74810 2018-05-02 05:47:24,384 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 05:47:24,385 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=32.2 M 2018-05-02 05:47:24,385 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:47:24,385 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.33 MB memstore heap size=32.16 MB 2018-05-02 05:47:25,635 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.33 MB at sequenceid=386 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/.tmp/f1/991129869afa49349c27a04e163824ba 2018-05-02 05:47:25,688 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/.tmp/f1/991129869afa49349c27a04e163824ba as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba 2018-05-02 05:47:25,734 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba, entries=248564, sequenceid=386, filesize=15.1 M 2018-05-02 05:47:25,737 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~15.33 MB/16071096, heap size ~32.16 MB/33722376, currentsize=171.94 KB/176064 for 89df5caac424c7424fede4183c6dce19 in 1352ms, sequenceid=386, compaction requested=false 2018-05-02 05:47:46,743 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:47:46,746 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:47:46,746 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,752 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:47:46,754 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,754 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:47:46,755 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:47:46,755 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:47:46,756 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:48:16,665 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.349 minutes, events=217212, succcessCount=4244, totalEvents=1370923, totalSuccessCount=79054 2018-05-02 05:48:22,487 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:22,487 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,488 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:22,491 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,495 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:22,496 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:22,517 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:22,517 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,517 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:22,518 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:22,520 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:22,521 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:23,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1410342 bytes) of f1 2018-05-02 05:48:23,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1410360 bytes) of f1 2018-05-02 05:48:23,242 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:23,242 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:23,243 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:23,245 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:23,246 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:23,246 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:23,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1410036 bytes) of f1 2018-05-02 05:48:28,665 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:27.839 minutes, events=13636, succcessCount=13636, totalEvents=79054, totalSuccessCount=79054 2018-05-02 05:48:49,405 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:49,405 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:49,406 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:49,410 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:49,412 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:49,413 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:49,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1410360 bytes) of f1 2018-05-02 05:48:51,740 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:51,740 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,740 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:51,743 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:51,745 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:51,748 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:48:51,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468740 bytes) of f1 2018-05-02 05:48:52,049 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:48:52,049 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:52,050 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:48:52,052 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:48:52,054 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:48:52,059 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:07,359 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:07,359 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:07,360 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:07,362 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:07,370 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:07,371 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:07,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468740 bytes) of f1 2018-05-02 05:49:14,650 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:14,651 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:14,653 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:14,655 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:14,659 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:14,664 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:15,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468626 bytes) of f1 2018-05-02 05:49:16,113 DEBUG [RS-EventLoopGroup-1-22] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:49:16,116 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:16,116 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:16,129 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:16,131 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:16,131 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:16,133 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:16,133 DEBUG [RS-EventLoopGroup-1-22] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:49:16,134 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:16,137 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:49:16,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 26d4b78c3c7d2fdea4d32bb21a3ca5fe, NAME => 'test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:49:16,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AuthenticationService 2018-05-02 05:49:16,156 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:16,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=SecureBulkLoadService 2018-05-02 05:49:16,156 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:16,156 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:16,156 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:16,157 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AccessControlService 2018-05-02 05:49:16,157 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:16,158 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:16,159 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 05:49:16,159 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:49:16,160 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:16,173 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:16,173 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:16,173 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:16,180 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 05:49:16,180 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 05:49:16,181 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:16,181 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:16,182 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:16,182 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:16,183 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:16,553 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf/6a8aa66cb5364117a56e66c694e2a7f7 2018-05-02 05:49:16,553 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:16,573 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 05:49:16,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468674 bytes) of f1 2018-05-02 05:49:16,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12407.seqid, newMaxSeqId=12407, maxSeqId=12406 2018-05-02 05:49:16,660 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 26d4b78c3c7d2fdea4d32bb21a3ca5fe; next sequenceid=12407 2018-05-02 05:49:16,671 INFO [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:49:16,676 DEBUG [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:49:16,676 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:16,685 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.020 minutes, events=10, succcessCount=5, totalEvents=1370933, totalSuccessCount=79059 2018-05-02 05:49:18,485 DEBUG [RS-EventLoopGroup-1-24] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,489 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:18,489 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,508 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:18,513 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,513 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:18,515 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,516 DEBUG [RS-EventLoopGroup-1-24] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,517 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:18,552 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 781 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:48632 deadline: 1525240248550, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:18,565 DEBUG [RS-EventLoopGroup-1-25] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,568 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:49:18,568 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,575 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:49:18,579 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,579 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:49:18,581 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:18,581 DEBUG [RS-EventLoopGroup-1-25] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:49:18,589 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:49:18,618 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 8208 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:32882 deadline: 1525240248618, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:20,691 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:49:20,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:49:20,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 05:49:20,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:20,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 05:49:20,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:20,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:20,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:20,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 05:49:20,742 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:20,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:20,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:49:20,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:49:20,809 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:49:20,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:49:20,820 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:20,842 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:49:20,843 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:49:20,844 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:20,847 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:20,929 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:49:20,950 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/b3695ba3826443ff91ddc686509faa2a 2018-05-02 05:49:20,972 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/eaed850681d24ac8926671fb83799c09 2018-05-02 05:49:20,972 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:20,988 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:49:21,159 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:21,161 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:21,166 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:21,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/57.seqid, newMaxSeqId=57, maxSeqId=56 2018-05-02 05:49:21,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=57 2018-05-02 05:49:21,399 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:49:21,403 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:49:21,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:21,881 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:22,105 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:49:22,134 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:49:22,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 05:49:22,135 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:22,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 05:49:22,135 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:22,135 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:22,135 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:22,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 05:49:22,136 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:22,136 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:22,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:49:22,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:49:22,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:22,159 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:49:22,159 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 05:49:22,194 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:22,194 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:22,296 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 05:49:22,296 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:22,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 05:49:22,349 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12886.seqid, newMaxSeqId=12886, maxSeqId=12885 2018-05-02 05:49:22,356 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=12886 2018-05-02 05:49:22,373 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:49:22,379 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 05:49:22,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:22,434 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:22,443 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:49:22,617 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:49:22,617 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:22,618 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:22,636 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:22,655 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:22,655 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:49:24,655 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:49:24,684 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:49:24,685 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:49:24,685 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:24,685 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:49:24,685 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:24,685 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:24,685 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:24,685 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:49:24,686 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:24,686 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:24,686 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:49:24,686 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:49:24,687 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:24,688 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:49:24,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:49:24,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 05:49:24,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:24,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 05:49:24,707 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:24,707 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:24,707 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:24,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 05:49:24,708 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:24,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:24,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:49:24,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:49:24,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:24,733 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:49:24,734 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:49:24,735 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:24,736 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:24,738 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:49:24,738 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:49:24,739 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:24,740 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:24,807 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 05:49:24,808 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:24,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:49:24,848 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:49:24,849 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:24,868 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:49:24,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11462.seqid, newMaxSeqId=11462, maxSeqId=11461 2018-05-02 05:49:24,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11462 2018-05-02 05:49:24,917 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:49:24,923 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:49:24,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:24,926 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12154.seqid, newMaxSeqId=12154, maxSeqId=12153 2018-05-02 05:49:24,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12154 2018-05-02 05:49:24,946 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:49:24,951 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:49:24,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:25,118 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:49:25,691 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:49:25,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:49:25,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:49:25,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:49:25,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:49:25,709 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:49:25,709 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:49:25,709 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:49:25,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:49:25,709 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:49:25,709 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:49:25,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:49:25,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:49:25,710 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:26,259 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:49:26,260 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:49:26,261 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:49:26,261 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:49:26,315 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:49:26,315 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:49:26,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:49:26,382 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13464.seqid, newMaxSeqId=13464, maxSeqId=13463 2018-05-02 05:49:26,393 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13464 2018-05-02 05:49:26,397 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:49:26,409 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:49:26,409 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 05:49:26,947 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304." 2018-05-02 05:49:26,947 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 670f6b815d2acac905130e5440d59304, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267. Requested from /172.27.61.83 2018-05-02 05:49:26,950 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:26,950 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 05:49:26,950 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:49:27,001 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12195.seqid, newMaxSeqId=12195, maxSeqId=12193 2018-05-02 05:49:27,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:27,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:27,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:27,014 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:49:27,014 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 670f6b815d2acac905130e5440d59304 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 record at close sequenceid=12193 2018-05-02 05:49:27,018 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 05:49:27,136 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:27,137 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:27,144 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:27,651 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:27,852 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827." 2018-05-02 05:49:27,852 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 78e8a528d65332a4f7661e8ab427a827, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656. Requested from /172.27.61.83 2018-05-02 05:49:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a." 2018-05-02 05:49:27,858 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 61e6bada2600d1326224ecb9ae7c237a, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656. Requested from /172.27.61.83 2018-05-02 05:49:27,858 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:27,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:49:27,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:27,866 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:27,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 05:49:27,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:27,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12791.seqid, newMaxSeqId=12791, maxSeqId=12789 2018-05-02 05:49:27,928 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:27,928 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:27,928 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:27,928 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:27,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13219.seqid, newMaxSeqId=13219, maxSeqId=13217 2018-05-02 05:49:27,931 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 78e8a528d65332a4f7661e8ab427a827 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 record at close sequenceid=12789 2018-05-02 05:49:27,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:27,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:27,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:49:27,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:27,961 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:27,961 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 61e6bada2600d1326224ecb9ae7c237a move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 record at close sequenceid=13217 2018-05-02 05:49:27,977 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:49:28,048 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:28,048 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:49:28,137 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:49:28,137 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:28,137 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:28,143 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:28,148 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:28,149 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:49:28,675 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.010 minutes, events=7, succcessCount=7, totalEvents=79061, totalSuccessCount=79061 2018-05-02 05:49:29,297 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62." 2018-05-02 05:49:29,297 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 665f3f34ec072c60acee3dc78af73b62, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656. Requested from /172.27.61.83 2018-05-02 05:49:29,297 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:29,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:49:29,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12991.seqid, newMaxSeqId=12991, maxSeqId=12989 2018-05-02 05:49:29,331 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:29,331 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:29,331 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:29,331 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,332 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 665f3f34ec072c60acee3dc78af73b62 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 record at close sequenceid=12989 2018-05-02 05:49:29,334 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:49:29,475 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb." 2018-05-02 05:49:29,475 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 8c7dd0ad2a67fa6a32d1f3694eef56eb, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267. Requested from /172.27.61.83 2018-05-02 05:49:29,476 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:49:29,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 05:49:29,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:49:29,506 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12788.seqid, newMaxSeqId=12788, maxSeqId=12786 2018-05-02 05:49:29,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:49:29,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:49:29,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:49:29,513 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:49:29,513 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 8c7dd0ad2a67fa6a32d1f3694eef56eb move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 record at close sequenceid=12786 2018-05-02 05:49:29,516 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 05:49:32,211 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 05:49:32,211 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:32,211 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 05:49:32,216 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 05:49:32,217 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 05:49:32,218 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 05:49:32,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1468722 bytes) of f1 2018-05-02 05:49:32,929 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:49:32,931 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:49:32,932 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:49:33,438 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:49:33,699 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:49:33,700 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:49:33,785 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:49:33,785 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:49:33,785 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:49:33,792 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:49:33,794 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:49:33,794 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:50:12,769 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=52.40 MB, freeSize=152.40 MB, max=204.80 MB, blockCount=830, accesses=834, hits=4, hitRatio=0.48%, , cachingAccesses=834, cachingHits=4, cachingHitsRatio=0.48%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:50:19,419 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=8, created chunk count=55, reused chunk count=20, reuseRatio=26.67% 2018-05-02 05:50:19,419 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:50:19,679 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:02.994 minutes, events=23, succcessCount=10, totalEvents=1370956, totalSuccessCount=79069 2018-05-02 05:51:19,639 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:51:19,641 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:51:19,645 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:51:20,148 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:51:20,331 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:51:20,331 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:51:20,412 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:51:20,412 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:51:20,412 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:51:20,417 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:51:20,421 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:51:20,421 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:55:12,769 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=52.40 MB, freeSize=152.40 MB, max=204.80 MB, blockCount=830, accesses=834, hits=4, hitRatio=0.48%, , cachingAccesses=834, cachingHits=4, cachingHitsRatio=0.48%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 05:55:19,418 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=8, created chunk count=55, reused chunk count=20, reuseRatio=26.67% 2018-05-02 05:55:19,419 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:55:24,612 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:55:24,616 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 530ms. 2018-05-02 05:55:25,148 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1454ms. 2018-05-02 05:55:26,604 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 4790ms. 2018-05-02 05:55:31,397 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 6192ms. 2018-05-02 05:55:37,591 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 8920ms. 2018-05-02 05:55:46,513 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 11293ms. 2018-05-02 05:55:57,809 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 18841ms. 2018-05-02 05:56:16,653 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 11506ms. 2018-05-02 05:56:19,638 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:56:19,639 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:56:19,641 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:56:20,147 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:56:20,748 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:56:20,748 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 05:56:20,930 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:56:20,930 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:56:20,930 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:56:20,939 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:56:20,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:56:20,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:56:28,162 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Trying to failover after sleeping for 11875ms. 2018-05-02 05:56:40,062 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Trying to failover after sleeping for 18520ms. 2018-05-02 05:56:58,603 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1474378706_1. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1474378706_1. Name node is in safe mode. The reported blocks 222 needs additional 175 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 11 failover attempts. Retrying after sleeping for 17318ms. 2018-05-02 05:57:15,926 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1474378706_1. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1474378706_1. Name node is in safe mode. The reported blocks 393 needs additional 4 blocks to reach the threshold 1.0000 of total blocks 397. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000005.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 11 failover attempts. Retrying after sleeping for 11121ms. 2018-05-02 06:00:12,769 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=52.40 MB, freeSize=152.40 MB, max=204.80 MB, blockCount=830, accesses=834, hits=4, hitRatio=0.48%, , cachingAccesses=834, cachingHits=4, cachingHitsRatio=0.48%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 06:00:19,418 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=8, created chunk count=55, reused chunk count=20, reuseRatio=26.67% 2018-05-02 06:00:19,419 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:00:54,298 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:01:19,638 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:01:19,643 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:01:19,644 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:01:20,148 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:01:20,369 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:01:20,369 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:01:20,425 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:01:20,425 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:01:20,425 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:01:20,430 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:01:20,431 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:01:20,431 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:01:47,255 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 2018-05-02 06:01:47,258 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 znode expired, triggering replicatorRemoved event 2018-05-02 06:01:47,259 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:01:47,755 DEBUG [RS-EventLoopGroup-1-27] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,757 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:01:47,757 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,759 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:01:47,761 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,761 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:01:47,765 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,766 DEBUG [RS-EventLoopGroup-1-27] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,766 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:01:47,772 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:01:47,791 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:01:47,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:01:47,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 06:01:47,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 06:01:47,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 06:01:47,796 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:01:47,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:01:47,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:01:47,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:01:47,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:01:47,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:01:47,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:01:47,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:01:47,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 06:01:47,825 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,825 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 06:01:47,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:01:47,825 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,825 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,825 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:01:47,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:01:47,826 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,833 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:01:47,833 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:01:47,835 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,835 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 06:01:47,838 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 06:01:47,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:01:47,839 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,844 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:01:47,844 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:01:47,848 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:01:47,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 5de3546305c82231844eb840c6cfa983, NAME => 'test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:01:47,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AuthenticationService 2018-05-02 06:01:47,849 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=SecureBulkLoadService 2018-05-02 06:01:47,849 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,849 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,849 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AccessControlService 2018-05-02 06:01:47,850 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,850 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5de3546305c82231844eb840c6cfa983 2018-05-02 06:01:47,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:01:47,850 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,850 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,851 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,875 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:01:47,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:01:47,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 06:01:47,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 06:01:47,876 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,876 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 06:01:47,877 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:01:47,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:01:47,878 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,878 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:01:47,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:01:47,879 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:01:47,879 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:01:47,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:01:47,880 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,880 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:01:47,880 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,880 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,880 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,880 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:01:47,880 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,880 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,880 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,880 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:01:47,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:01:47,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:01:47,881 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,881 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:01:47,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:01:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:01:47,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:01:47,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:01:47,883 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,883 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:01:47,883 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,883 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,883 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:01:47,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:01:47,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:01:47,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:01:47,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:01:47,886 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:01:47,886 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,886 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:01:47,886 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,887 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,887 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:01:47,887 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,887 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,887 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:01:47,887 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:01:47,887 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:01:47,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:01:47,888 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,889 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,889 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 8ac6e5d607af84df53c95bd38a03c313, NAME => 'test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:01:47,889 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AuthenticationService 2018-05-02 06:01:47,889 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:47,889 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=SecureBulkLoadService 2018-05-02 06:01:47,890 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:47,890 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:47,890 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:47,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AccessControlService 2018-05-02 06:01:47,887 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:01:47,890 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:01:47,890 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,890 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:47,890 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:47,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:01:47,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:01:47,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:01:47,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:01:47,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:47,964 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:01:47,964 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 06:01:47,965 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,966 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,968 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:01:47,968 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:01:47,969 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,970 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,976 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:01:47,976 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:01:47,985 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:47,993 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:47,997 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:01:47,997 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:01:48,007 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,008 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,009 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:01:48,009 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:01:48,017 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,018 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,031 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:01:48,031 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:01:48,032 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,033 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,049 INFO [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 06:01:48,050 INFO [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,051 WARN [StoreFileOpenerThread-f1-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #868 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,051 INFO [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,051 WARN [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #882 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,057 INFO [StoreFileOpenerThread-info-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,057 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 06:01:48,058 WARN [StoreFileOpenerThread-info-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #895 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,058 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,058 INFO [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:01:48,058 WARN [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #883 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,083 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:01:48,083 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,087 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 06:01:48,087 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,087 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 06:01:48,087 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,089 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1/a22fbfb1317a4c1493bae2cc0fc84cec 2018-05-02 06:01:48,089 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,093 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:01:48,093 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:01:48,093 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,093 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,099 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:01:48,099 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:01:48,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 06:01:48,102 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:01:48,102 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 06:01:48,105 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/7e7819a9ed7b4762a10d8bb24cd6d15a 2018-05-02 06:01:48,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:01:48,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983 2018-05-02 06:01:48,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:01:48,122 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:01:48,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:01:48,166 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/952e6e0835fe40d8bf53e29e592d158c 2018-05-02 06:01:48,166 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,174 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11954.seqid, newMaxSeqId=11954, maxSeqId=11953 2018-05-02 06:01:48,186 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:01:48,186 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,188 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12768.seqid, newMaxSeqId=12768, maxSeqId=12767 2018-05-02 06:01:48,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=11954 2018-05-02 06:01:48,195 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12428.seqid, newMaxSeqId=12428, maxSeqId=12427 2018-05-02 06:01:48,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:01:48,196 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:01:48,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:01:48,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12768 2018-05-02 06:01:48,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:01:48,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12789.seqid, newMaxSeqId=12789, maxSeqId=12788 2018-05-02 06:01:48,202 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:01:48,203 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=27 2018-05-02 06:01:48,204 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:01:48,204 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:01:48,208 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:01:48,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,210 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=12428 2018-05-02 06:01:48,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 5de3546305c82231844eb840c6cfa983; next sequenceid=408 2018-05-02 06:01:48,213 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=408 2018-05-02 06:01:48,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12789 2018-05-02 06:01:48,215 INFO [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:01:48,216 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:01:48,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=28 2018-05-02 06:01:48,220 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:01:48,222 DEBUG [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:01:48,222 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:01:48,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,222 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:01:48,224 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12752.seqid, newMaxSeqId=12752, maxSeqId=12751 2018-05-02 06:01:48,228 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:01:48,228 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,228 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:01:48,228 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,228 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:01:48,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,230 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:01:48,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12752 2018-05-02 06:01:48,237 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:01:48,243 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:01:48,244 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:01:48,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:01:48,253 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 8ac6e5d607af84df53c95bd38a03c313; next sequenceid=411 2018-05-02 06:01:48,259 INFO [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:01:48,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=411 2018-05-02 06:01:48,264 DEBUG [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:48,265 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:01:48,269 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:01:48,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:01:49,167 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:01:52,726 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=12:24.050 minutes, events=8, succcessCount=8, totalEvents=79069, totalSuccessCount=79069 2018-05-02 06:01:52,796 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:01:52,798 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:01:52,802 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:01:53,306 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:01:53,595 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:01:53,595 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:01:53,661 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:01:53,661 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:01:53,661 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:01:53,668 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:01:53,671 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:01:53,671 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:02:19,726 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=6, succcessCount=3, totalEvents=1370962, totalSuccessCount=79072 2018-05-02 06:02:28,246 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:03:22,978 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,978 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:03:22,980 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,983 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,984 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:22,992 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:03:22,996 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:03:22,996 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/5 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:03:23,007 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 2018-05-02 06:03:23,009 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 znode expired, triggering replicatorRemoved event 2018-05-02 06:03:23,010 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:03:23,595 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:03:23,622 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:03:23,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:03:23,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:03:23,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:03:23,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:03:23,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:03:23,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:03:23,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,633 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:03:23,633 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:03:23,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => dc953453430fbf031584084fad7c31bd, NAME => 'test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:03:23,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 041977f7087dd987f3bc1c3b0d191155, NAME => 'test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:03:23,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AuthenticationService 2018-05-02 06:03:23,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AuthenticationService 2018-05-02 06:03:23,633 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=SecureBulkLoadService 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=SecureBulkLoadService 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AccessControlService 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AccessControlService 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase dc953453430fbf031584084fad7c31bd 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:03:23,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:03:23,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,637 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:03:23,637 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:03:23,638 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,638 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,648 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:03:23,648 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:03:23,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 4c37ee7a4e1210e481debdc2933fc4d2, NAME => 'test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 28608f50f9f828e7d3ab571a72b0d5f3, NAME => 'test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AuthenticationService 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AuthenticationService 2018-05-02 06:03:23,649 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,649 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=SecureBulkLoadService 2018-05-02 06:03:23,649 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,649 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,648 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:03:23,649 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=SecureBulkLoadService 2018-05-02 06:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AccessControlService 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:03:23,650 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,650 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,650 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:03:23,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:03:23,650 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,650 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:03:23,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AccessControlService 2018-05-02 06:03:23,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:03:23,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:03:23,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:03:23,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:03:23,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,652 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,652 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:03:23,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:03:23,652 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,654 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:03:23,655 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:03:23,656 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,656 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,657 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:03:23,658 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:03:23,659 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,660 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,676 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:03:23,677 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:03:23,677 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,678 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,681 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:03:23,681 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:03:23,681 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:03:23,681 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 06:03:23,682 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,682 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,683 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,683 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,683 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:03:23,683 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:03:23,684 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=830, currentSize=52.40 MB, freeSize=152.40 MB, maxSize=204.80 MB, heapSize=52.40 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,684 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,687 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1/f62905fc6764413996ad23803ef34639 2018-05-02 06:03:23,687 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,688 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:03:23,688 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,699 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:03:23,701 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:03:23,715 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:03:23,715 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,720 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:03:23,735 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf/8206d33252364d01b7ddcb8a35cf4b14 2018-05-02 06:03:23,735 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,741 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf/d830ee103d2b41e0ad35903c835935d7 2018-05-02 06:03:23,741 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf/719182bd2f5b43a9b5002dd5ebd23549 2018-05-02 06:03:23,741 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,742 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:03:23,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:03:23,752 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 06:03:23,753 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd 2018-05-02 06:03:23,772 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:03:23,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:03:23,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 041977f7087dd987f3bc1c3b0d191155; next sequenceid=408 2018-05-02 06:03:23,792 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=408 2018-05-02 06:03:23,793 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:03:23,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12019.seqid, newMaxSeqId=12019, maxSeqId=12018 2018-05-02 06:03:23,793 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:23,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12239.seqid, newMaxSeqId=12239, maxSeqId=12238 2018-05-02 06:03:23,794 INFO [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:03:23,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12684.seqid, newMaxSeqId=12684, maxSeqId=12683 2018-05-02 06:03:23,795 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:03:23,798 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:03:23,798 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,799 DEBUG [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:03:23,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:03:23,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:03:23,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 4c37ee7a4e1210e481debdc2933fc4d2; next sequenceid=12239 2018-05-02 06:03:23,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 28608f50f9f828e7d3ab571a72b0d5f3; next sequenceid=12019 2018-05-02 06:03:23,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened dc953453430fbf031584084fad7c31bd; next sequenceid=12684 2018-05-02 06:03:23,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=408 2018-05-02 06:03:23,806 INFO [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:03:23,806 INFO [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:03:23,807 INFO [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:03:23,809 DEBUG [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:03:23,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,809 DEBUG [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:03:23,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,809 DEBUG [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:03:23,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,819 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:03:23,821 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:03:23,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:23,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:03:23,850 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=411 2018-05-02 06:03:23,853 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:03:23,856 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:03:23,857 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:03:28,624 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:03:28,625 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:03:28,627 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:03:28,737 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:36.012 minutes, events=3, succcessCount=3, totalEvents=79072, totalSuccessCount=79072 2018-05-02 06:03:29,131 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:03:29,431 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:03:29,432 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:03:29,521 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:03:29,521 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:03:29,521 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:03:29,527 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:03:29,530 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:03:29,530 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:03:57,562 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:13,658 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,P\327\2245\345\ry8,1525239890069.685781049fdcc89efe3561b69e4d3810." 2018-05-02 06:04:13,658 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 685781049fdcc89efe3561b69e4d3810, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:13,688 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\345\ryC^P\327t,1525239890069.89df5caac424c7424fede4183c6dce19." 2018-05-02 06:04:13,688 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 89df5caac424c7424fede4183c6dce19, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:13,688 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:13,688 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 685781049fdcc89efe3561b69e4d3810, disabling compactions & flushes 2018-05-02 06:04:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 89df5caac424c7424fede4183c6dce19, disabling compactions & flushes 2018-05-02 06:04:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:04:13,689 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.94 MB memstore heap size=4.07 MB 2018-05-02 06:04:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:04:13,690 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=752.23 KB memstore heap size=1.54 MB 2018-05-02 06:04:13,816 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=752.23 KB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/.tmp/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:04:13,870 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/.tmp/f1/14e594e5be3b4b11ab73ecade93c1f88 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:04:13,899 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88, entries=11903, sequenceid=407, filesize=757.6 K 2018-05-02 06:04:13,902 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.94 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/.tmp/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:04:13,902 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~752.23 KB/770280, heap size ~1.54 MB/1615104, currentsize=0 B/0 for 89df5caac424c7424fede4183c6dce19 in 212ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:13,926 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/.tmp/f1/246ab8cb4abd4f17b71986dd12fa3c37 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:04:13,951 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37, entries=31439, sequenceid=407, filesize=1.9 M 2018-05-02 06:04:13,955 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.94 MB/2031024, heap size ~4.07 MB/4265584, currentsize=0 B/0 for 685781049fdcc89efe3561b69e4d3810 in 266ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:13,955 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:13,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:13,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:13,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:13,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:04:13,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 89df5caac424c7424fede4183c6dce19 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=407 2018-05-02 06:04:13,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:04:13,994 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:14,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:14,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:14,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:14,012 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:04:14,012 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 685781049fdcc89efe3561b69e4d3810 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=407 2018-05-02 06:04:14,016 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:04:15,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7." 2018-05-02 06:04:15,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 299ab8318d1b1d267135f988608683b7, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:15,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd." 2018-05-02 06:04:15,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close dc953453430fbf031584084fad7c31bd, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:15,379 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:15,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 06:04:15,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:04:15,379 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:15,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing dc953453430fbf031584084fad7c31bd, disabling compactions & flushes 2018-05-02 06:04:15,379 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:04:15,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12430.seqid, newMaxSeqId=12430, maxSeqId=12428 2018-05-02 06:04:15,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12686.seqid, newMaxSeqId=12686, maxSeqId=12684 2018-05-02 06:04:15,405 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:15,406 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:15,406 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:15,406 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:04:15,406 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 299ab8318d1b1d267135f988608683b7 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12428 2018-05-02 06:04:15,408 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:15,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:15,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:15,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:04:15,409 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:04:15,409 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding dc953453430fbf031584084fad7c31bd move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12684 2018-05-02 06:04:15,411 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:04:15,629 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81." 2018-05-02 06:04:15,629 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a0792481dc7d859b1b63b04bf9adad81, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:15,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136." 2018-05-02 06:04:15,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1d954f21d711345a9587d995cecea136, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:15,631 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:15,631 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:15,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 06:04:15,632 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:04:15,632 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:04:15,632 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:04:15,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12544.seqid, newMaxSeqId=12544, maxSeqId=12542 2018-05-02 06:04:15,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11956.seqid, newMaxSeqId=11956, maxSeqId=11954 2018-05-02 06:04:15,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:15,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:15,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:15,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:04:15,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 1d954f21d711345a9587d995cecea136 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12542 2018-05-02 06:04:15,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:15,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:04:15,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:15,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:15,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:04:15,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding a0792481dc7d859b1b63b04bf9adad81 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=11954 2018-05-02 06:04:15,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 06:04:16,541 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\0245\345\ryC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155." 2018-05-02 06:04:16,541 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 041977f7087dd987f3bc1c3b0d191155, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:16,542 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\320\327\2245\345\ry&,1525239890069.51969dda9dfa8895c283f334f944e248." 2018-05-02 06:04:16,542 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 51969dda9dfa8895c283f334f944e248, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:16,542 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:16,542 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:16,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 041977f7087dd987f3bc1c3b0d191155, disabling compactions & flushes 2018-05-02 06:04:16,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 51969dda9dfa8895c283f334f944e248, disabling compactions & flushes 2018-05-02 06:04:16,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:04:16,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:04:16,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:04:16,565 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:16,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:16,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:16,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:16,567 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:04:16,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 51969dda9dfa8895c283f334f944e248 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=411 2018-05-02 06:04:16,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:04:16,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:16,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:16,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:16,571 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:04:16,571 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 041977f7087dd987f3bc1c3b0d191155 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=408 2018-05-02 06:04:16,573 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:04:16,772 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353." 2018-05-02 06:04:16,772 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 7d91c8087e31e21951799651a5262353, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:16,773 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:16,773 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 7d91c8087e31e21951799651a5262353, disabling compactions & flushes 2018-05-02 06:04:16,773 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:04:16,797 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 06:04:16,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:16,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:16,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:16,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:04:16,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 7d91c8087e31e21951799651a5262353 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=2 2018-05-02 06:04:16,806 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:04:17,754 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2." 2018-05-02 06:04:17,755 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close bb80fda45cdcaf338a2a3cfb863adfc2, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:17,756 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:17,756 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:04:17,756 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:17,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12770.seqid, newMaxSeqId=12770, maxSeqId=12768 2018-05-02 06:04:17,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:17,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:17,791 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:17,791 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:17,791 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding bb80fda45cdcaf338a2a3cfb863adfc2 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=12768 2018-05-02 06:04:17,794 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:18,197 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\2245\345\ryC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0." 2018-05-02 06:04:18,197 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 2e8da78a5421f95de8c75e0053e1d4a0, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:18,198 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2." 2018-05-02 06:04:18,198 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 4c37ee7a4e1210e481debdc2933fc4d2, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:18,198 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:18,198 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:18,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 2e8da78a5421f95de8c75e0053e1d4a0, disabling compactions & flushes 2018-05-02 06:04:18,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 4c37ee7a4e1210e481debdc2933fc4d2, disabling compactions & flushes 2018-05-02 06:04:18,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:04:18,220 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12241.seqid, newMaxSeqId=12241, maxSeqId=12239 2018-05-02 06:04:18,222 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:18,225 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:18,225 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:18,225 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:18,225 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:04:18,225 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 4c37ee7a4e1210e481debdc2933fc4d2 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12239 2018-05-02 06:04:18,227 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:18,227 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:18,228 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:18,228 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,228 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 2e8da78a5421f95de8c75e0053e1d4a0 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=408 2018-05-02 06:04:18,234 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 06:04:18,234 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,963 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:18,966 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:18,967 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:19,137 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\336P\327\2245\345\rZ,1525239890069.3f499471b0415a38ad5efe046913cba2." 2018-05-02 06:04:19,137 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3f499471b0415a38ad5efe046913cba2, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:19,138 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3." 2018-05-02 06:04:19,138 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 28608f50f9f828e7d3ab571a72b0d5f3, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:19,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:19,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:19,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:04:19,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 28608f50f9f828e7d3ab571a72b0d5f3, disabling compactions & flushes 2018-05-02 06:04:19,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:04:19,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:19,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12021.seqid, newMaxSeqId=12021, maxSeqId=12019 2018-05-02 06:04:19,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:19,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:19,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:19,188 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,188 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 3f499471b0415a38ad5efe046913cba2 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=408 2018-05-02 06:04:19,190 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:19,190 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:19,190 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:19,190 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:04:19,190 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 28608f50f9f828e7d3ab571a72b0d5f3 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12019 2018-05-02 06:04:19,191 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,192 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:04:19,470 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:19,471 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\312\032\362\206\274\241\257\f,1525239890069.8ac6e5d607af84df53c95bd38a03c313." 2018-05-02 06:04:19,471 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 8ac6e5d607af84df53c95bd38a03c313, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:19,471 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:19,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 8ac6e5d607af84df53c95bd38a03c313, disabling compactions & flushes 2018-05-02 06:04:19,472 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:04:19,493 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:04:19,498 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:19,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:19,499 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:19,499 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:04:19,499 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 8ac6e5d607af84df53c95bd38a03c313 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=411 2018-05-02 06:04:19,501 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:04:19,719 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:19,720 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:04:19,739 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=20, succcessCount=9, totalEvents=1370982, totalSuccessCount=79081 2018-05-02 06:04:19,828 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:04:19,828 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:19,828 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:19,834 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:19,836 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:19,836 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538." 2018-05-02 06:04:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 60955ebb25dcf0aeb6d46e894a921538, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:20,276 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059." 2018-05-02 06:04:20,276 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 29fe0b7866912efc70bb3f2d7fd83059, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:20,276 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:20,277 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:20,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:04:20,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:04:20,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=28 2018-05-02 06:04:20,300 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12754.seqid, newMaxSeqId=12754, maxSeqId=12752 2018-05-02 06:04:20,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:20,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:20,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:20,304 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,304 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 60955ebb25dcf0aeb6d46e894a921538 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=28 2018-05-02 06:04:20,306 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:20,306 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:20,306 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:20,306 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,306 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 29fe0b7866912efc70bb3f2d7fd83059 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=12752 2018-05-02 06:04:20,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,495 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,W\2245\345\ryCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97." 2018-05-02 06:04:20,496 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3ea52812fafc49b1651e26e1bd43ec97, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:20,496 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96." 2018-05-02 06:04:20,496 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close da9e02fc1fdd80392463141e6bc6cf96, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:20,496 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:20,496 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:20,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3ea52812fafc49b1651e26e1bd43ec97, disabling compactions & flushes 2018-05-02 06:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 06:04:20,497 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Running close preflush of {}3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:04:20,497 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:04:20,497 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.39 MB memstore heap size=32.30 MB 2018-05-02 06:04:20,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12747.seqid, newMaxSeqId=12747, maxSeqId=12745 2018-05-02 06:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:20,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:20,522 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:04:20,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding da9e02fc1fdd80392463141e6bc6cf96 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12745 2018-05-02 06:04:20,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:04:20,903 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.39 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/.tmp/f1/2c27a1bafac241928300cca4169c9f94 2018-05-02 06:04:20,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/.tmp/f1/2c27a1bafac241928300cca4169c9f94 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1/2c27a1bafac241928300cca4169c9f94 2018-05-02 06:04:20,952 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1/2c27a1bafac241928300cca4169c9f94, entries=249635, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:20,955 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~15.39 MB/16137472, heap size ~32.30 MB/33867568, currentsize=0 B/0 for 3ea52812fafc49b1651e26e1bd43ec97 in 458ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:20,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:04:20,978 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:20,983 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:20,984 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:20,984 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:20,984 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:04:20,984 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 3ea52812fafc49b1651e26e1bd43ec97 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=404 2018-05-02 06:04:20,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:04:21,243 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4." 2018-05-02 06:04:21,243 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a0620fc83de532a37f6a9bb8f99cc6c4, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:21,244 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\250k\312\032\362\206\274\212,1525239890069.40744bb706fe10eab3c8964d0c6b003e." 2018-05-02 06:04:21,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:21,244 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 40744bb706fe10eab3c8964d0c6b003e, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855. Requested from /172.27.61.83 2018-05-02 06:04:21,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 06:04:21,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:04:21,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:21,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:04:21,245 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Running close preflush of {}40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:04:21,245 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.40 MB memstore heap size=32.32 MB 2018-05-02 06:04:21,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12888.seqid, newMaxSeqId=12888, maxSeqId=12886 2018-05-02 06:04:21,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:21,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:21,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:21,281 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:04:21,281 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding a0620fc83de532a37f6a9bb8f99cc6c4 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12886 2018-05-02 06:04:21,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:04:21,563 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.40 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/.tmp/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:04:21,587 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/.tmp/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:04:21,625 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0, entries=249802, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:21,628 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~15.40 MB/16150048, heap size ~32.32 MB/33890216, currentsize=0 B/0 for 40744bb706fe10eab3c8964d0c6b003e in 383ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:21,628 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:21,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:21,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:21,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:21,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:21,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:21,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 40744bb706fe10eab3c8964d0c6b003e move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 record at close sequenceid=404 2018-05-02 06:04:21,666 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:24,188 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:24,189 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:24,192 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:24,696 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:24,928 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:24,928 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:04:25,002 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:04:25,002 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:25,002 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:25,008 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:25,010 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:25,010 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:28,738 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=17, succcessCount=17, totalEvents=79089, totalSuccessCount=79089 Wed May 2 06:04:58 UTC 2018 Terminating regionserver 2018-05-02 06:04:58,351 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:04:58,351 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:04:58,351 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:04:58,351 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:04:58,352 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:04:58,352 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:04:58,352 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:04:58,352 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:04:58,352 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:04:58,352 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:04:58,352 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:04:58,352 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:04:58,352 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:04:58,352 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:04:58,352 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:04:58,352 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:04:58,353 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353' ***** 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=29.615 seconds, events=4, succcessCount=4, totalEvents=79093, totalSuccessCount=79093 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:04:58,353 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=38.615 seconds, events=24, succcessCount=12, totalEvents=1371006, totalSuccessCount=79093 2018-05-02 06:04:58,353 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:04:58,353 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,355 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,355 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:04:58,355 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:04:58,355 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:04:58,355 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:04:58,355 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 exiting 2018-05-02 06:04:58,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:04:58,370 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@2c837bb5{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:04:58,370 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:04:58,371 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:04:58,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:04:58,373 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:04:58,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:04:58,373 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:04:58,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:04:58,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,374 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,374 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,374 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,374 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,374 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 24479666cac01319b99b1d0e11484b5c, disabling compactions & flushes 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:04:58,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 06:04:58,375 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=3.53 MB memstore heap size=7.41 MB 2018-05-02 06:04:58,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 06:04:58,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,376 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,377 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,378 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:04:58,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:04:58,378 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x0f880892 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:04:58,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:04:58,378 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 19 regions to close 2018-05-02 06:04:58,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12791.seqid, newMaxSeqId=12791, maxSeqId=12789 2018-05-02 06:04:58,399 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12591.seqid, newMaxSeqId=12591, maxSeqId=12589 2018-05-02 06:04:58,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,402 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:04:58,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:04:58,403 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 5de3546305c82231844eb840c6cfa983, disabling compactions & flushes 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,403 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:04:58,403 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:04:58,404 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 9c4d77e622ed44a126e39f057f044750, disabling compactions & flushes 2018-05-02 06:04:58,404 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Running close preflush of {}9c4d77e622ed44a126e39f057f044750 2018-05-02 06:04:58,404 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.39 MB memstore heap size=32.32 MB 2018-05-02 06:04:58,422 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:58,433 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,434 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:04:58,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:04:58,434 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,435 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:04:58,435 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Running close preflush of {}a1d694475a6981010a6489a33c4db464 2018-05-02 06:04:58,435 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.39 MB memstore heap size=32.29 MB 2018-05-02 06:04:58,474 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=3.53 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/.tmp/f1/c96bbf08131a49779b97ac2c5c0843ad 2018-05-02 06:04:58,506 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/.tmp/f1/c96bbf08131a49779b97ac2c5c0843ad as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/c96bbf08131a49779b97ac2c5c0843ad 2018-05-02 06:04:58,531 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/c96bbf08131a49779b97ac2c5c0843ad, entries=57244, sequenceid=407, filesize=3.5 M 2018-05-02 06:04:58,533 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~3.53 MB/3700488, heap size ~7.41 MB/7766568, currentsize=0 B/0 for 24479666cac01319b99b1d0e11484b5c in 158ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:58,555 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:58,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,561 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:04:58,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:04:58,561 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 385c8f00672f754fa0d7448f5ac543fa, disabling compactions & flushes 2018-05-02 06:04:58,561 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Running close preflush of {}385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:04:58,562 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=15.49 MB memstore heap size=32.47 MB 2018-05-02 06:04:58,864 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.39 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/.tmp/f1/fc387eb319f242cba0384b0a240bb24d 2018-05-02 06:04:58,894 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.39 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/.tmp/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:04:58,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/.tmp/f1/fc387eb319f242cba0384b0a240bb24d as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1/fc387eb319f242cba0384b0a240bb24d 2018-05-02 06:04:58,907 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=15.49 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/.tmp/f1/20cc702a3aaf4197b9dd17722b21fc36 2018-05-02 06:04:58,920 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/.tmp/f1/329e30ab65dc41c3a17097e18564f58b as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:04:58,931 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/.tmp/f1/20cc702a3aaf4197b9dd17722b21fc36 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1/20cc702a3aaf4197b9dd17722b21fc36 2018-05-02 06:04:58,932 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1/fc387eb319f242cba0384b0a240bb24d, entries=249797, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:58,934 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~15.39 MB/16137472, heap size ~32.32 MB/33889600, currentsize=0 B/0 for 9c4d77e622ed44a126e39f057f044750 in 530ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:58,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:04:58,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b, entries=249568, sequenceid=404, filesize=15.2 M 2018-05-02 06:04:58,944 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~15.39 MB/16137472, heap size ~32.29 MB/33858456, currentsize=0 B/0 for a1d694475a6981010a6489a33c4db464 in 509ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:58,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:04:58,956 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1/20cc702a3aaf4197b9dd17722b21fc36, entries=250995, sequenceid=404, filesize=15.3 M 2018-05-02 06:04:58,958 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~15.49 MB/16238080, heap size ~32.47 MB/34052016, currentsize=0 B/0 for 385c8f00672f754fa0d7448f5ac543fa in 395ms, sequenceid=404, compaction requested=false 2018-05-02 06:04:58,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:04:58,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:58,973 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:58,985 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:04:58,985 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:04:58,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:04:58,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:04:58,986 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,986 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:58,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 06:04:58,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:04:58,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 06:04:58,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:04:59,001 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:04:59,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,006 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:04:59,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:04:59,006 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:04:59,007 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:04:59,021 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12844.seqid, newMaxSeqId=12844, maxSeqId=12842 2018-05-02 06:04:59,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/59.seqid, newMaxSeqId=59, maxSeqId=57 2018-05-02 06:04:59,025 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,025 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,025 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,025 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:04:59,025 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:04:59,025 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 26d4b78c3c7d2fdea4d32bb21a3ca5fe, disabling compactions & flushes 2018-05-02 06:04:59,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:04:59,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:04:59,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,027 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:04:59,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:04:59,028 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:04:59,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:04:59,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,032 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,039 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,039 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:04:59,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:04:59,040 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 06:04:59,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:04:59,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12409.seqid, newMaxSeqId=12409, maxSeqId=12407 2018-05-02 06:04:59,049 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11464.seqid, newMaxSeqId=11464, maxSeqId=11462 2018-05-02 06:04:59,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,051 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,052 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:04:59,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:04:59,052 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:04:59,052 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,054 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:04:59,054 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:04:59,054 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:04:59,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12346.seqid, newMaxSeqId=12346, maxSeqId=12344 2018-05-02 06:04:59,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,091 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:04:59,091 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:04:59,091 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,092 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:04:59,092 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:04:59,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12071.seqid, newMaxSeqId=12071, maxSeqId=12069 2018-05-02 06:04:59,102 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13466.seqid, newMaxSeqId=13466, maxSeqId=13464 2018-05-02 06:04:59,104 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:04:59,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:04:59,105 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing f61045f3bb8866c33d9b05635d777d75, disabling compactions & flushes 2018-05-02 06:04:59,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:04:59,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,107 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:04:59,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:04:59,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,108 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 51119cebc42546d1c9f2590eec5a49b3, disabling compactions & flushes 2018-05-02 06:04:59,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Running close preflush of {}51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:04:59,108 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=5.02 MB memstore heap size=10.51 MB 2018-05-02 06:04:59,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12156.seqid, newMaxSeqId=12156, maxSeqId=12154 2018-05-02 06:04:59,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,113 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:04:59,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:04:59,113 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,114 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 06:04:59,114 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:04:59,121 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:04:59,124 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,124 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,124 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,125 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:04:59,125 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:04:59,145 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13404.seqid, newMaxSeqId=13404, maxSeqId=13402 2018-05-02 06:04:59,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,149 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:04:59,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:04:59,178 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] hbase.ScheduledChore: Chore: MemstoreFlusherChore was stopped 2018-05-02 06:04:59,204 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.leaseChecker] regionserver.Leases: Closed leases 2018-05-02 06:04:59,248 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=5.02 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/.tmp/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:04:59,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/.tmp/f1/ad174b44a0ea459c97ae086ef4638f39 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:04:59,293 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39, entries=81235, sequenceid=407, filesize=5.0 M 2018-05-02 06:04:59,295 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~5.02 MB/5259912, heap size ~10.51 MB/11021408, currentsize=0 B/0 for 51119cebc42546d1c9f2590eec5a49b3 in 187ms, sequenceid=407, compaction requested=false 2018-05-02 06:04:59,296 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:04:59,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:04:59,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:59,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:59,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:59,319 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:04:59,319 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:04:59,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353; all regions closed. 2018-05-02 06:04:59,379 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:04:59,414 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 2 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:04:59,414 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525239609353:(num 1525240033093) 2018-05-02 06:04:59,414 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:04:59,415 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 06:04:59,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:04:59,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:04:59,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:04:59,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:04:59,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:04:59,419 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 06:04:59,420 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:04:59,420 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:04:59,440 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:04:59,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ca, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:59,443 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:04:59,445 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c00ca closed 2018-05-02 06:04:59,445 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353; zookeeper connection closed. 2018-05-02 06:04:59,445 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:04:59,459 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:05:22 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:05:24,687 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:05:24,690 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:05:24,690 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:05:24,690 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:05:24,690 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:05:25,225 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:05:25,226 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:05:25,226 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:05:25,226 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:05:25,228 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:05:25,229 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020605 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:05:25,230 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:05:25,231 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:05:25,232 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:05:25,232 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:05:25,233 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020605 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:05:25,234 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:05:25,235 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:05:25,235 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:05:25,235 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:05:25,235 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:05:25,238 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:05:25,239 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020605, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:05:25,437 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:05:25,928 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:05:25,996 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:05:26,592 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:05:26,600 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:05:27,173 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:05:27,173 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:05:27,173 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:05:27,273 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:05:27,480 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:05:27,480 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:05:27,532 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:05:27,878 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 06:05:27,904 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:05:27,907 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:05:27,907 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:05:27,908 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:05:27,908 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:05:27,908 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:05:28,151 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:05:28,395 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:05:28,412 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:05:28,525 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 06:05:28,700 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:05:28,704 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:05:28,707 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:05:28,722 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:28,724 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:05:28,730 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:05:30,363 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:05:30,375 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:05:30,446 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:05:30,454 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:05:30,455 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:05:30,456 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:05:30,491 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:05:30,493 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:05:30,501 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:05:30,508 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:05:30 UTC 2018 2018-05-02 06:05:30,508 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:05:30 UTC 2018 2018-05-02 06:05:30,508 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:51:47 UTC 2018 2018-05-02 06:05:30,511 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:05:30,523 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:05:30,532 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939009d, negotiated timeout = 90000 2018-05-02 06:05:30,535 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:05:30,536 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d connected 2018-05-02 06:05:30,558 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:05:30,622 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:05:30,623 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:05:30,623 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:05:30,623 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:05:30,623 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:05:30,623 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:05:30,628 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:05:30,678 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:05:30,683 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:05:30,684 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:05:30,693 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:05:30,699 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:05:30,761 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:05:30,761 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:05:30,761 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:05:30,798 INFO [main] util.log: Logging initialized @7238ms 2018-05-02 06:05:30,914 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:05:30,931 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:05:30,931 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:05:30,934 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:05:30,934 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:05:30,934 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:05:30,970 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:05:30,972 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:05:31,037 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:05:31,038 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:05:31,215 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:05:31,220 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:05:31,234 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:05:31,234 INFO [main] server.Server: Started @7674ms 2018-05-02 06:05:31,273 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:05:31,281 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:05:31,301 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:05:31,301 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:05:31,306 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:05:31,334 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x06c529c0 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:05:31,343 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/444172515@5f7b05c8 2018-05-02 06:05:31,345 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:05:31,347 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:05:31,347 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:05:31,351 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00f3, negotiated timeout = 90000 2018-05-02 06:05:31,396 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45afed00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:05:31,398 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c352b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 06:05:31,404 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 06:05:31,417 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:05:31,417 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:05:31,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:05:31,432 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:05:31,680 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:05:31,683 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:05:31,688 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:05:31,688 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:05:31,692 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:05:31,693 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:05:31,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:05:31,744 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:05:31,745 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:05:31,745 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:05:31,766 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:05:31,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:05:31,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:05:31,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:05:31,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:05:31,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:05:31,768 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:05:31,768 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:05:31,768 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:05:31,777 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:05:31,777 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:05:31,777 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:05:31,778 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:05:31,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:05:31,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:05:31,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:05:31,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:05:31,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:05:31,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:05:31,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:05:31,881 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:05:31,887 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:05:31,887 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:05:31,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:05:31,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:05:31,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:05:31,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:05:31,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:05:31,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:05:31,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:05:31,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:05:31,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:05:31,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:05:31,892 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:05:31,893 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:05:31,893 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:05:31,893 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:05:31,893 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:05:31,894 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:05:31,894 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:05:31,894 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:05:31,898 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:05:31,904 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:05:31,910 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:05:32,154 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:05:32,471 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:05:34,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:05:34,758 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:05:34,759 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:05:34,759 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:05:34,759 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:05:34,760 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:05:34,775 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525239798055 with port=16020, startcode=1525241125281 2018-05-02 06:05:34,874 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:05:34,874 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:05:34,876 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:05:34,999 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:05:35,016 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 736 from initSASLContext. 2018-05-02 06:05:35,042 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 107 for processing by initSASLContext 2018-05-02 06:05:35,046 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:05:35,048 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:05:35,048 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:05:35,049 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:05:35,101 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:05:35,101 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:05:35,101 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:05:35,152 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:05:35,173 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:05:35,493 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:05:35,511 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:05:35,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:05:35,582 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:05:35,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:05:35,614 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:05:35,663 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:05:35,663 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:05:35,664 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:05:35,664 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:05:35,664 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:05:35,664 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:05:35,665 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:05:35,667 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:05:35,823 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 starting 2018-05-02 06:05:35,826 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:05:35,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:05:35,838 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:05:35,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:05:35,950 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:05:35,960 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] 2018-05-02 06:05:36,052 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x2631f08d939009d 2018-05-02 06:05:36,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:05:36,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:05:36,055 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281' 2018-05-02 06:05:36,055 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:05:36,059 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:05:36,060 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:05:36,060 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:05:36,060 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:05:36,060 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281' 2018-05-02 06:05:36,060 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:05:36,061 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:05:36,062 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:05:36,062 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:05:36,062 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:05:37,517 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:05:37,518 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:05:39,164 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:05:39,549 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 279 ms, current pipeline: [] 2018-05-02 06:05:39,550 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281.1525241139164 2018-05-02 06:05:39,550 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:06:31,375 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0] zookeeper.ZooKeeper: Session: 0x1631f08b26c00f3 closed 2018-05-02 06:06:31,375 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x06c529c0-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:06:41,075 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,076 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,081 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,085 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:06:41,085 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/6 2018-05-02 06:06:41,086 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,106 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:41,109 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 znode expired, triggering replicatorRemoved event 2018-05-02 06:06:41,112 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:06:41,628 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:06:41,633 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:06:41,633 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:41,640 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:06:41,649 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:41,650 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:06:41,651 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:41,652 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:06:41,652 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:06:41,851 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 06:06:41,857 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:06:41,874 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:06:41,940 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281.meta.1525241201874.meta 2018-05-02 06:06:41,940 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:06:41,995 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:06:42,088 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 06:06:42,094 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:42,099 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 06:06:42,099 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:42,099 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:42,100 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:42,100 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 06:06:42,100 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:42,100 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:42,104 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 06:06:42,108 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 06:06:42,109 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 06:06:42,141 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 06:06:42,141 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 06:06:42,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:06:42,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:06:42,293 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:42,317 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:42,658 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971 2018-05-02 06:06:42,723 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3 2018-05-02 06:06:42,728 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:42,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:06:42,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:06:42,742 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:42,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:42,776 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03 2018-05-02 06:06:42,776 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:42,804 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 06:06:42,833 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 06:06:42,893 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/1441.seqid, newMaxSeqId=1441, maxSeqId=1440 2018-05-02 06:06:42,900 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=1441 2018-05-02 06:06:42,949 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 06:06:42,997 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 06:06:42,999 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:43,167 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:06:43,170 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:06:43,170 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:43,177 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:06:43,180 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:43,181 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:06:43,186 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:06:43,187 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:06:43,187 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:06:43,821 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:43,847 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:43,847 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:06:43,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 06:06:43,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 06:06:43,849 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,849 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,849 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 06:06:43,849 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,849 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:06:43,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:43,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,866 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:06:43,866 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:06:43,870 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:06:43,871 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:06:43,871 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:06:43,871 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,871 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,871 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:43,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 06:06:43,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 06:06:43,872 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,872 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,872 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 06:06:43,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:43,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:06:43,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 06:06:43,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:43,874 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,875 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:06:43,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:43,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,884 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,885 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,894 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:06:43,894 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:06:43,895 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,896 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,898 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:06:43,898 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:06:43,899 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:06:43,899 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:06:43,900 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:43,900 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,900 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:06:43,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:06:43,903 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,903 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:06:43,903 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,903 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,903 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,903 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:06:43,903 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,904 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,904 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,904 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:06:43,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:43,904 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,905 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,906 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:43,906 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:43,906 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,907 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:43,907 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:06:43,907 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 06:06:43,908 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 06:06:43,908 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,908 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 735c68afadbe039ceafe7e37c71a82b8, NAME => 'test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:06:43,908 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 06:06:43,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AuthenticationService 2018-05-02 06:06:43,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:06:43,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=SecureBulkLoadService 2018-05-02 06:06:43,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:06:43,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:06:43,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,909 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,909 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AccessControlService 2018-05-02 06:06:43,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:06:43,910 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,910 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:06:43,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:43,911 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:06:43,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:43,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:06:43,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 8cb8f1e8202d0fae01b5300bd7c59bcb, NAME => 'test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:06:43,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AuthenticationService 2018-05-02 06:06:43,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=SecureBulkLoadService 2018-05-02 06:06:43,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:43,913 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,913 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AccessControlService 2018-05-02 06:06:43,914 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:06:43,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:43,915 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,971 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 06:06:43,971 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:43,973 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:06:43,973 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:06:43,973 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:06:43,973 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:06:43,975 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,975 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,976 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,977 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,980 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:06:43,980 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:06:43,981 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:06:43,981 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:06:43,981 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,982 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:06:43,982 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:06:43,983 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,983 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,983 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.17 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,985 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 06:06:43,986 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:43,986 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,986 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:06:44,005 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:06:44,006 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 06:06:44,006 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,010 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:06:44,010 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:06:44,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:06:44,085 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:06:44,085 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,094 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/07854b903e5c4a14aab13c9789d93907 2018-05-02 06:06:44,098 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11527.seqid, newMaxSeqId=11527, maxSeqId=11526 2018-05-02 06:06:44,100 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:06:44,101 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12191.seqid, newMaxSeqId=12191, maxSeqId=12190 2018-05-02 06:06:44,101 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:06:44,105 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/3f2d2f80200b4e7086e08019eff91a27 2018-05-02 06:06:44,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11527 2018-05-02 06:06:44,111 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:44,112 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:06:44,112 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12717.seqid, newMaxSeqId=12717, maxSeqId=12716 2018-05-02 06:06:44,116 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=12191 2018-05-02 06:06:44,118 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:06:44,118 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:06:44,119 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:44,124 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:06:44,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12717 2018-05-02 06:06:44,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12428.seqid, newMaxSeqId=12428, maxSeqId=12427 2018-05-02 06:06:44,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12428 2018-05-02 06:06:44,135 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/d9d7b3335aed4b73b1949214243017d7 2018-05-02 06:06:44,135 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,136 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:44,143 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:06:44,143 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,144 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/4fedc898e84f4979967e3b8666fea966 2018-05-02 06:06:44,146 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13223.seqid, newMaxSeqId=13223, maxSeqId=13222 2018-05-02 06:06:44,147 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,147 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:44,150 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:06:44,154 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:06:44,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,157 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:06:44,159 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 06:06:44,159 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:44,159 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13223 2018-05-02 06:06:44,162 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:44,166 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:06:44,166 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,167 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:06:44,168 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:06:44,174 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=414 2018-05-02 06:06:44,179 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:06:44,179 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:44,184 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:06:44,184 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,185 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 735c68afadbe039ceafe7e37c71a82b8; next sequenceid=414 2018-05-02 06:06:44,188 INFO [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:44,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:06:44,193 DEBUG [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:06:44,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,195 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 8cb8f1e8202d0fae01b5300bd7c59bcb; next sequenceid=414 2018-05-02 06:06:44,198 INFO [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:44,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:06:44,202 DEBUG [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:06:44,203 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:44,205 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=411 2018-05-02 06:06:44,207 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:44,213 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:06:44,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:06:46,931 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@32da3cb1 2018-05-02 06:06:46,932 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:06:46,933 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:06:46,934 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:06:46,937 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939009e, negotiated timeout = 10000 2018-05-02 06:06:46,969 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:06:46,981 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:06:47,141 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:06:47,142 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:06:47,145 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:06:47,656 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:06:47,831 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:06:47,832 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:06:47,909 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:06:47,911 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:06:47,911 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:06:47,918 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:06:47,921 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:06:47,921 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:06:48,008 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:06:48,008 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:06:48,009 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:06:48,009 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:06:48,009 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:06:48,010 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 06:06:48,011 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:06:48,011 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:06:48,014 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:06:48,015 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:06:48,015 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:06:48,015 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:07:28,162 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:07:31,912 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=6, succcessCount=3, totalEvents=6, totalSuccessCount=3 2018-05-02 06:08:15,928 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:17,939 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:17,944 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:18,935 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:21,938 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:08:21,939 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:21,939 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:08:21,943 DEBUG [RS-EventLoopGroup-1-7] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:21,950 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:21,957 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:21,958 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:21,959 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:21,959 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:21,959 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:08:52,098 DEBUG [RS-EventLoopGroup-1-8] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:53,028 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:53,035 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:55,101 DEBUG [RS-EventLoopGroup-1-9] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:58,106 DEBUG [RS-EventLoopGroup-1-10] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:08:58,115 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:58,124 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:58,125 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:58,129 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:58,129 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:58,130 DEBUG [RS-EventLoopGroup-1-10] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:09:30,128 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:09:30,130 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:09:30,130 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:30,132 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:09:30,135 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:30,136 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:09:30,138 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:30,138 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:09:30,138 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:09:30,178 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2018-05-02 06:09:31,551 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:09:31,552 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:09:31,552 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:31,554 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:09:31,556 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:31,556 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:09:31,559 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:31,559 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:09:31,559 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:09:40,506 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,507 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:09:40,510 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,511 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,512 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:09:40,515 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:09:40,519 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:09:40,520 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/7 2018-05-02 06:09:40,520 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:10:02,483 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:10:02,485 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:10:02,485 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:02,488 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:10:02,510 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:02,510 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:10:02,519 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:02,519 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:10:02,519 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:10:10,611 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:10:10,629 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:10:10,629 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => 32b24a1d0ec05868d69a34a41559e784, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:10:10,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => e8edde5a00b30c080b02d1b096794b39, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:10:10,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AuthenticationService 2018-05-02 06:10:10,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:10:10,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AuthenticationService 2018-05-02 06:10:10,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:10:10,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=SecureBulkLoadService 2018-05-02 06:10:10,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=SecureBulkLoadService 2018-05-02 06:10:10,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,631 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,631 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:10:10,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:10:10,632 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => bcf3e62f0ae8e672bee1318720d62930, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:10:10,632 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:10:10,632 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 54c783f1faee76bcce84aee6145e82d1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:10:10,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AccessControlService 2018-05-02 06:10:10,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AuthenticationService 2018-05-02 06:10:10,633 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:10:10,633 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=SecureBulkLoadService 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AuthenticationService 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => a47cc34ca47759b3fd7bcaa79faebd3d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AccessControlService 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=SecureBulkLoadService 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AccessControlService 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,634 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,634 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => b32f7e3b20e736fd1681093bef6b435d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:10:10,634 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,635 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,634 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:10:10,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AuthenticationService 2018-05-02 06:10:10,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AuthenticationService 2018-05-02 06:10:10,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:10:10,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 70ed82a86a0f0c62d692e8ffd1c0f904, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:10:10,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=SecureBulkLoadService 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AuthenticationService 2018-05-02 06:10:10,636 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,636 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,636 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=SecureBulkLoadService 2018-05-02 06:10:10,636 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AccessControlService 2018-05-02 06:10:10,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AccessControlService 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=SecureBulkLoadService 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,637 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AccessControlService 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:10:10,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:10:10,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:10:10,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:10:10,638 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,638 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:10:10,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:10:10,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. service=AccessControlService 2018-05-02 06:10:10,638 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,638 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,638 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,638 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:10:10,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:10:10,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,659 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:10:10,659 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:10:10,660 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,661 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:10:10,661 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:10:10,661 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:10:10,661 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:10:10,661 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,662 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,662 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,663 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,663 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,664 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,664 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:10:10,665 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:10:10,665 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,665 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,666 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,667 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:10:10,667 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:10:10,667 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:10:10,667 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:10:10,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:10:10,673 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,673 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:10:10,672 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:10:10,674 DEBUG [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1 2018-05-02 06:10:10,674 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,672 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:10:10,677 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:10:10,672 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,678 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:10:10,679 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,680 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=48, currentSize=553.63 KB, freeSize=204.26 MB, maxSize=204.80 MB, heapSize=553.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,680 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:10:10,681 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,681 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,681 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,684 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:10:10,685 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,685 INFO [StoreOpener-b32f7e3b20e736fd1681093bef6b435d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,686 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:10:10,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d 2018-05-02 06:10:10,689 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:10:10,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,703 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened bcf3e62f0ae8e672bee1318720d62930; next sequenceid=2 2018-05-02 06:10:10,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened e8edde5a00b30c080b02d1b096794b39; next sequenceid=2 2018-05-02 06:10:10,707 INFO [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:10:10,708 INFO [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:10:10,710 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,710 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened 32b24a1d0ec05868d69a34a41559e784; next sequenceid=2 2018-05-02 06:10:10,712 INFO [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:10:10,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 54c783f1faee76bcce84aee6145e82d1; next sequenceid=2 2018-05-02 06:10:10,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened a47cc34ca47759b3fd7bcaa79faebd3d; next sequenceid=2 2018-05-02 06:10:10,715 INFO [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:10:10,715 INFO [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:10:10,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened b32f7e3b20e736fd1681093bef6b435d; next sequenceid=2 2018-05-02 06:10:10,719 INFO [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:10:10,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 70ed82a86a0f0c62d692e8ffd1c0f904; next sequenceid=2 2018-05-02 06:10:10,721 INFO [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:10:10,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=2 2018-05-02 06:10:10,732 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:10:10,732 DEBUG [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,733 DEBUG [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,734 DEBUG [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:10:10,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,734 DEBUG [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:10:10,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,734 DEBUG [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:10:10,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,735 DEBUG [PostOpenDeployTasks:b32f7e3b20e736fd1681093bef6b435d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:10:10,735 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,736 DEBUG [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:10:10,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:10,736 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:10:10,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:10:12,031 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:10:13,917 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:27.010 minutes, events=3, succcessCount=3, totalEvents=3, totalSuccessCount=3 2018-05-02 06:10:15,636 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:10:15,637 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:10:15,641 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:10:16,149 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:10:16,231 DEBUG [RS-EventLoopGroup-1-14] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:10:16,232 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:10:16,232 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:16,234 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:10:16,247 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:16,248 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:10:16,261 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:16,261 DEBUG [RS-EventLoopGroup-1-14] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:10:16,262 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:10:16,432 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:10:16,432 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:10:16,517 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:10:16,517 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:10:16,517 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:10:16,524 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:10:16,528 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:10:16,528 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:10:28,719 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=553.63 KB, freeSize=204.26 MB, max=204.80 MB, blockCount=48, accesses=151, hits=88, hitRatio=58.28%, , cachingAccesses=151, cachingHits=88, cachingHitsRatio=58.28%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:10:31,918 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=2, succcessCount=1, totalEvents=8, totalSuccessCount=4 2018-05-02 06:10:35,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=2, reused chunk count=0, reuseRatio=0.00% 2018-05-02 06:10:35,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:10:54,807 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:54,807 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:54,808 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:54,820 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:54,826 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:54,827 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:10:55,246 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:55,247 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:55,247 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:55,259 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:55,260 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:55,261 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:11,913 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:11,914 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:11,914 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:11,985 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:11,987 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:11,988 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:15,300 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:01.383 minutes, events=5363, succcessCount=5363, totalEvents=5366, totalSuccessCount=5366 2018-05-02 06:11:17,645 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 119 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:11:20,025 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:20,025 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:20,026 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:20,101 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:20,104 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:20,105 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:31,991 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.073 minutes, events=140723, succcessCount=17787, totalEvents=140731, totalSuccessCount=17791 2018-05-02 06:11:45,673 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 83635ms 2018-05-02 06:11:47,140 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:11:47,141 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:11:47,144 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:11:47,648 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:11:47,823 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:11:47,823 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:11:47,901 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:11:47,901 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:11:47,901 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:11:47,908 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:11:47,912 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:11:47,912 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:11:48,820 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 169 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:11:56,273 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91969ms 2018-05-02 06:12:05,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 118464ms 2018-05-02 06:12:06,008 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:12:15,615 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.315 minutes, events=56624, succcessCount=56624, totalEvents=61990, totalSuccessCount=61990 2018-05-02 06:12:16,477 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 19394ms 2018-05-02 06:12:22,710 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 06:12:22,714 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.8 MTotal Memstore Off-Heap size=0, Region memstore size=26.3 M 2018-05-02 06:12:22,714 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:12:22,724 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=12.00 MB memstore heap size=26.26 MB 2018-05-02 06:12:23,641 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=12.00 MB at sequenceid=339 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/.tmp/f1/821797aa04f34c5ba99842ed2104658a 2018-05-02 06:12:23,741 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/.tmp/f1/821797aa04f34c5ba99842ed2104658a as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/821797aa04f34c5ba99842ed2104658a 2018-05-02 06:12:23,780 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/821797aa04f34c5ba99842ed2104658a, entries=215389, sequenceid=339, filesize=11.9 M 2018-05-02 06:12:23,796 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~12.00 MB/12587926, heap size ~26.26 MB/27534120, currentsize=77.68 KB/79548 for 54c783f1faee76bcce84aee6145e82d1 in 1073ms, sequenceid=339, compaction requested=false 2018-05-02 06:12:25,670 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 171214ms 2018-05-02 06:12:32,286 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.295 minutes, events=971905, succcessCount=57819, totalEvents=1112636, totalSuccessCount=75610 2018-05-02 06:12:34,644 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 06:12:34,645 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.8 MTotal Memstore Off-Heap size=0, Region memstore size=29.3 M 2018-05-02 06:12:34,645 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:12:34,646 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.39 MB memstore heap size=29.29 MB 2018-05-02 06:12:35,529 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.39 MB at sequenceid=380 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/.tmp/f1/60b614564dba4b2ebef91378bb1169f6 2018-05-02 06:12:35,583 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/.tmp/f1/60b614564dba4b2ebef91378bb1169f6 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/60b614564dba4b2ebef91378bb1169f6 2018-05-02 06:12:35,614 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/60b614564dba4b2ebef91378bb1169f6, entries=240267, sequenceid=380, filesize=13.2 M 2018-05-02 06:12:35,619 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~13.39 MB/14039677, heap size ~29.29 MB/30714416, currentsize=91.56 KB/93753 for b32f7e3b20e736fd1681093bef6b435d in 972ms, sequenceid=380, compaction requested=false 2018-05-02 06:12:35,671 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 205351ms 2018-05-02 06:12:38,848 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 154 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:12:45,706 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 104284ms 2018-05-02 06:12:45,725 DEBUG [RS-EventLoopGroup-1-19] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:12:45,727 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:12:45,727 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:45,729 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:12:45,731 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:45,731 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:12:45,732 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:45,732 DEBUG [RS-EventLoopGroup-1-19] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:12:45,732 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:12:48,747 DEBUG [RS-EventLoopGroup-1-20] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:12:48,748 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:12:48,748 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:48,751 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:12:48,755 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:48,756 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:12:48,765 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:48,765 DEBUG [RS-EventLoopGroup-1-20] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:12:48,766 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:12:49,085 DEBUG [RS-EventLoopGroup-1-21] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:12:49,087 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:12:49,087 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,091 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:12:49,093 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,093 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:12:49,095 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,095 DEBUG [RS-EventLoopGroup-1-21] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:12:49,095 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:12:55,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 172112ms 2018-05-02 06:13:05,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 131079ms 2018-05-02 06:13:09,314 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:13:09,315 DEBUG [MemStoreFlusher.0] regionserver.FlushAllLargeStoresPolicy: Since none of the CFs were above the size, flushing all. 2018-05-02 06:13:09,315 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=97.06 KB memstore heap size=141.03 KB 2018-05-02 06:13:09,377 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=96.92 KB at sequenceid=1574 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/e5d26c4e75d945c380cda28584eef54c 2018-05-02 06:13:09,480 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=142 B at sequenceid=1574 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/232a77d6fb9d4ddaa90b8f503b3232d4 2018-05-02 06:13:09,500 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/e5d26c4e75d945c380cda28584eef54c as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c 2018-05-02 06:13:09,527 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c, entries=592, sequenceid=1574, filesize=105.3 K 2018-05-02 06:13:09,532 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/232a77d6fb9d4ddaa90b8f503b3232d4 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4 2018-05-02 06:13:09,557 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4, entries=2, sequenceid=1574, filesize=4.7 K 2018-05-02 06:13:09,560 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~97.06 KB/99392, heap size ~141.45 KB/144848, currentsize=0 B/0 for 1588230740 in 244ms, sequenceid=1574, compaction requested=true 2018-05-02 06:13:09,570 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit: Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:13:09,571 DEBUG [MemStoreFlusher.0] regionserver.CompactSplit: Small Compaction requested: system; Because: MemStoreFlusher.0; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2018-05-02 06:13:09,571 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:13:09,571 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:13:09,572 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:13:09,572 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] compactions.SortedCompactionPolicy: Selecting compaction from 2 store files, 0 compacting, 2 eligible, 10 blocking 2018-05-02 06:13:09,594 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store hbase:meta,,1.1588230740; time since last major compaction 1131199ms 2018-05-02 06:13:09,598 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store hbase:meta,,1.1588230740; time since last major compaction 1131190ms 2018-05-02 06:13:09,599 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.HStore: 1588230740 - table: Initiating major compaction (all files) 2018-05-02 06:13:09,599 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.HRegion: Starting compaction of table in hbase:meta,,1.1588230740 2018-05-02 06:13:09,600 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=10.3 K 2018-05-02 06:13:09,601 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.HStore: 1588230740 - info: Initiating major compaction (all files) 2018-05-02 06:13:09,601 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 06:13:09,602 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=490.7 K 2018-05-02 06:13:09,603 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] compactions.Compactor: Compacting 2fa8671e8559457caa88f9377b1dca03, keycount=17, bloomtype=NONE, size=5.5 K, encoding=NONE, seqNum=1102, earliestPutTs=1525237102016 2018-05-02 06:13:09,604 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] compactions.Compactor: Compacting b79727d75bb540fcaf5e3b370a19f971, keycount=1372, bloomtype=NONE, size=227.5 K, encoding=NONE, seqNum=1102, earliestPutTs=1525238415337 2018-05-02 06:13:09,605 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] compactions.Compactor: Compacting 232a77d6fb9d4ddaa90b8f503b3232d4, keycount=2, bloomtype=NONE, size=4.7 K, encoding=NONE, seqNum=1574, earliestPutTs=1525241409943 2018-05-02 06:13:09,605 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] compactions.Compactor: Compacting ccab58085909451891d996ee39baf6b3, keycount=941, bloomtype=NONE, size=157.9 K, encoding=NONE, seqNum=1437, earliestPutTs=1525240907581 2018-05-02 06:13:09,607 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] compactions.Compactor: Compacting e5d26c4e75d945c380cda28584eef54c, keycount=592, bloomtype=NONE, size=105.3 K, encoding=NONE, seqNum=1574, earliestPutTs=1525241203541 2018-05-02 06:13:09,651 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:13:09,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] throttle.PressureAwareThroughputController: 1588230740#table#compaction#4 average throughput is 0.52 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:13:09,737 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:13:09,786 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] throttle.PressureAwareThroughputController: 1588230740#info#compaction#5 average throughput is 8.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:13:09,812 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/1c4610df23af45aebb0c862393f196e4 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/1c4610df23af45aebb0c862393f196e4 2018-05-02 06:13:09,827 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/0c003f984cd642e5b859d64c4d300296 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/0c003f984cd642e5b859d64c4d300296 2018-05-02 06:13:09,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.HStore: Completed major compaction of 2 (all) file(s) in table of 1588230740 into 1c4610df23af45aebb0c862393f196e4(size=5.7 K), total size for store is 5.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 06:13:09,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=table, priority=8, startTime=1525241589570; duration=0sec 2018-05-02 06:13:09,851 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-longCompactions-1525241135575] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:13:09,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.HStore: Completed major compaction of 3 (all) file(s) in info of 1588230740 into 0c003f984cd642e5b859d64c4d300296(size=334.1 K), total size for store is 334.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2018-05-02 06:13:09,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=7, startTime=1525241589569; duration=0sec 2018-05-02 06:13:09,852 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525241589569] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:13:17,287 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:17,287 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:17,287 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:17,299 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:17,300 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:17,300 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:17,434 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:17,434 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:17,434 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:17,452 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:17,454 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:17,454 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:17,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1364040 bytes) of f1 2018-05-02 06:13:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1364100 bytes) of f1 2018-05-02 06:13:21,398 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:21,398 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,399 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:21,414 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,417 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:21,417 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:21,452 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:21,452 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,452 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:21,468 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,471 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:21,472 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:21,489 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:21,489 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,490 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:21,506 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:21,507 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:21,508 DEBUG [RS-EventLoopGroup-1-26] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:24,019 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:08.404 minutes, events=16736, succcessCount=16736, totalEvents=78726, totalSuccessCount=78726 2018-05-02 06:13:32,200 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:32,200 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:32,202 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:32,222 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:32,224 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:32,224 DEBUG [RS-EventLoopGroup-1-27] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:33,019 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.733 minutes, events=142668, succcessCount=3117, totalEvents=1255304, totalSuccessCount=78727 2018-05-02 06:13:34,554 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:34,554 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:34,554 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:34,570 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:34,572 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:34,572 DEBUG [RS-EventLoopGroup-1-28] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:34,787 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:34,787 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:34,787 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:34,831 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:34,832 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:34,833 DEBUG [RS-EventLoopGroup-1-29] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:35,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4] to archive 2018-05-02 06:13:35,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c] to archive 2018-05-02 06:13:35,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:13:35,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:13:35,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/table/2fa8671e8559457caa88f9377b1dca03 2018-05-02 06:13:35,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/b79727d75bb540fcaf5e3b370a19f971 2018-05-02 06:13:35,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/table/232a77d6fb9d4ddaa90b8f503b3232d4 2018-05-02 06:13:35,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/ccab58085909451891d996ee39baf6b3 2018-05-02 06:13:35,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/e5d26c4e75d945c380cda28584eef54c 2018-05-02 06:13:37,117 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:37,117 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:37,118 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:37,261 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:37,263 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:37,264 DEBUG [RS-EventLoopGroup-1-30] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:38,542 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:38,542 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:38,542 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:38,565 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:38,566 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:38,566 DEBUG [RS-EventLoopGroup-1-31] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:39,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454595 bytes) of f1 2018-05-02 06:13:39,354 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:39,354 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:39,354 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:39,374 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:39,376 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:39,376 DEBUG [RS-EventLoopGroup-1-32] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:39,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454940 bytes) of f1 2018-05-02 06:13:43,134 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:43,134 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:43,134 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:43,145 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:43,147 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:43,147 DEBUG [RS-EventLoopGroup-1-33] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:44,027 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:44,027 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:44,027 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:44,041 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:44,042 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:44,043 DEBUG [RS-EventLoopGroup-1-34] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:56,059 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:56,059 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:56,059 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:56,076 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:56,077 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:56,078 DEBUG [RS-EventLoopGroup-1-35] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:59,039 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:59,039 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:59,040 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:59,052 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:59,054 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:59,054 DEBUG [RS-EventLoopGroup-1-36] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:13:59,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454595 bytes) of f1 2018-05-02 06:13:59,666 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:13:59,666 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:59,666 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:13:59,677 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:13:59,678 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:13:59,679 DEBUG [RS-EventLoopGroup-1-37] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:00,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454895 bytes) of f1 2018-05-02 06:14:07,693 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:07,693 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:07,693 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:07,718 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:07,720 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:07,720 DEBUG [RS-EventLoopGroup-1-38] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:08,178 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:08,178 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:08,178 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:08,196 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:08,197 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:08,198 DEBUG [RS-EventLoopGroup-1-39] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:11,802 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:11,802 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:11,803 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:11,827 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:11,829 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:11,829 DEBUG [RS-EventLoopGroup-1-40] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:17,563 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:17,563 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:17,563 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:17,575 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:17,576 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:17,576 DEBUG [RS-EventLoopGroup-1-41] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:22,355 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:22,355 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:22,356 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:22,371 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:22,372 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:22,372 DEBUG [RS-EventLoopGroup-1-42] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:22,639 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:22,639 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:22,639 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:22,669 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:22,670 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:22,671 DEBUG [RS-EventLoopGroup-1-43] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:22,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454895 bytes) of f1 2018-05-02 06:14:23,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454610 bytes) of f1 2018-05-02 06:14:27,027 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:03.008 minutes, events=3, succcessCount=3, totalEvents=78729, totalSuccessCount=78729 2018-05-02 06:14:28,099 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:28,099 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:28,099 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:28,114 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:28,116 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:28,117 DEBUG [RS-EventLoopGroup-1-44] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:29,201 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:29,201 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:29,201 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:29,212 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:29,219 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:29,225 DEBUG [RS-EventLoopGroup-1-45] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:33,027 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=6, succcessCount=3, totalEvents=1255310, totalSuccessCount=78730 2018-05-02 06:14:44,524 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:44,524 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:44,525 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:44,539 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:44,540 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:44,540 DEBUG [RS-EventLoopGroup-1-46] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:47,661 DEBUG [RS-EventLoopGroup-1-47] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:14:47,663 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:47,663 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:47,665 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:47,666 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:47,667 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:47,667 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:47,667 DEBUG [RS-EventLoopGroup-1-47] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:47,668 DEBUG [RS-EventLoopGroup-1-47] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:48,005 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:48,006 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,006 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:48,025 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:48,027 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:48,028 DEBUG [RS-EventLoopGroup-1-48] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:50,573 DEBUG [RS-EventLoopGroup-1-49] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,575 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:50,575 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,575 DEBUG [RS-EventLoopGroup-1-50] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,576 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:50,577 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,577 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:50,580 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:50,580 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,580 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:50,581 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,581 DEBUG [RS-EventLoopGroup-1-49] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,581 DEBUG [RS-EventLoopGroup-1-49] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:50,581 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,581 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:50,582 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,582 DEBUG [RS-EventLoopGroup-1-50] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,582 DEBUG [RS-EventLoopGroup-1-50] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:50,684 DEBUG [RS-EventLoopGroup-1-51] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,686 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:50,686 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,693 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:50,695 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,695 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:50,696 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:50,696 DEBUG [RS-EventLoopGroup-1-51] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:50,696 DEBUG [RS-EventLoopGroup-1-51] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:50,699 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:14:50,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 46af8f9145c39f07531ceaa92c7f8dbc, NAME => 'test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:14:50,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AuthenticationService 2018-05-02 06:14:50,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:50,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=SecureBulkLoadService 2018-05-02 06:14:50,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:50,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:50,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:50,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AccessControlService 2018-05-02 06:14:50,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:50,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:50,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:14:50,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:14:50,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:50,732 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:14:50,732 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:14:50,733 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:50,734 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:50,758 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1/76ab8edd7657482f8dbe68fd37422b11 2018-05-02 06:14:50,758 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:50,765 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:14:50,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:50,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 46af8f9145c39f07531ceaa92c7f8dbc; next sequenceid=414 2018-05-02 06:14:50,791 INFO [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:14:50,794 DEBUG [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:14:50,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:51,558 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:51,558 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,558 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:51,577 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,579 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:51,580 DEBUG [RS-EventLoopGroup-1-52] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:51,849 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:51,849 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,849 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:51,863 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,864 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:51,865 DEBUG [RS-EventLoopGroup-1-53] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:52,452 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:14:52,465 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:14:52,465 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 06:14:52,465 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:52,466 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 06:14:52,466 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:52,466 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:52,466 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:52,466 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 06:14:52,466 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:52,466 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:52,466 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:14:52,467 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:14:52,467 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:52,478 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:14:52,479 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:14:52,480 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:52,480 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:52,532 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 06:14:52,532 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:52,538 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:14:52,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13408.seqid, newMaxSeqId=13408, maxSeqId=13407 2018-05-02 06:14:52,566 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13408 2018-05-02 06:14:52,571 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:14:52,578 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:14:52,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:52,679 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:14:52,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:14:52,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 06:14:52,693 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:52,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 06:14:52,693 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:52,693 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:52,693 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:52,693 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 06:14:52,694 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:52,694 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:52,694 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:14:52,694 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:14:52,694 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:52,705 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:14:52,705 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:14:52,706 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:52,707 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:52,727 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 06:14:52,727 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:52,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:14:52,752 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12848.seqid, newMaxSeqId=12848, maxSeqId=12847 2018-05-02 06:14:52,757 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=12848 2018-05-02 06:14:52,761 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:14:52,764 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:14:52,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:54,499 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:14:54,507 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:14:54,507 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 06:14:54,507 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:54,507 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 06:14:54,507 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:54,507 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:54,507 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:54,508 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 06:14:54,508 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:54,508 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:54,508 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:14:54,508 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:14:54,508 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:54,519 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:14:54,519 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:14:54,520 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:54,521 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:54,543 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 06:14:54,543 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:54,548 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:14:54,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13473.seqid, newMaxSeqId=13473, maxSeqId=13472 2018-05-02 06:14:54,570 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13473 2018-05-02 06:14:54,574 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:14:54,578 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:14:54,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:55,079 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a." 2018-05-02 06:14:55,080 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 61e6bada2600d1326224ecb9ae7c237a, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391. Requested from /172.27.61.83 2018-05-02 06:14:55,082 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:55,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:14:55,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,086 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1." 2018-05-02 06:14:55,086 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 63390c1b726b541c3ebd2a1a8679aaf1, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391. Requested from /172.27.61.83 2018-05-02 06:14:55,087 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:55,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:14:55,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,103 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13225.seqid, newMaxSeqId=13225, maxSeqId=13223 2018-05-02 06:14:55,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11529.seqid, newMaxSeqId=11529, maxSeqId=11527 2018-05-02 06:14:55,108 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:14:55,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:14:55,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:14:55,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:14:55,111 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,111 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 61e6bada2600d1326224ecb9ae7c237a move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 record at close sequenceid=13223 2018-05-02 06:14:55,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:14:55,112 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:14:55,112 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,112 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 63390c1b726b541c3ebd2a1a8679aaf1 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 record at close sequenceid=11527 2018-05-02 06:14:55,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:14:55,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:14:55,716 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:14:55,717 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:14:55,722 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:14:55,887 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d." 2018-05-02 06:14:55,888 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 59a7b13a4cf2cd2376c378f77087088d, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391. Requested from /172.27.61.83 2018-05-02 06:14:55,889 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:55,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:14:55,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:55,909 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12430.seqid, newMaxSeqId=12430, maxSeqId=12428 2018-05-02 06:14:55,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:14:55,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:14:55,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:14:55,915 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:55,915 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 59a7b13a4cf2cd2376c378f77087088d move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 record at close sequenceid=12428 2018-05-02 06:14:55,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:14:56,226 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:14:56,254 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:14:56,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 89df5caac424c7424fede4183c6dce19, NAME => 'test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:14:56,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AuthenticationService 2018-05-02 06:14:56,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:56,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=SecureBulkLoadService 2018-05-02 06:14:56,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:56,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:56,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:56,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AccessControlService 2018-05-02 06:14:56,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:56,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:56,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 89df5caac424c7424fede4183c6dce19 2018-05-02 06:14:56,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:14:56,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:56,293 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:14:56,294 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:14:56,295 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:56,295 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:56,314 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:14:56,326 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba 2018-05-02 06:14:56,327 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:56,332 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19 2018-05-02 06:14:56,349 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:14:56,353 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 89df5caac424c7424fede4183c6dce19; next sequenceid=414 2018-05-02 06:14:56,357 INFO [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:14:56,362 DEBUG [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:14:56,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:56,441 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:14:56,442 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:14:56,526 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:14:56,527 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:14:56,527 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:14:56,534 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:14:56,537 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:14:56,537 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:14:57,179 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:14:57,185 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:14:57,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:14:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 06:14:57,186 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 06:14:57,186 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:57,186 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:57,186 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 06:14:57,186 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:57,186 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:14:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:14:57,187 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 26d4b78c3c7d2fdea4d32bb21a3ca5fe, NAME => 'test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 06:14:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AuthenticationService 2018-05-02 06:14:57,190 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=SecureBulkLoadService 2018-05-02 06:14:57,191 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:57,191 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:57,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:57,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AccessControlService 2018-05-02 06:14:57,191 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:57,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:57,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:14:57,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:14:57,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:57,195 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:14:57,195 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:14:57,197 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:57,197 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:57,199 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:14:57,199 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 06:14:57,200 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:57,200 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:57,213 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 06:14:57,213 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:57,221 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:14:57,225 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf/6a8aa66cb5364117a56e66c694e2a7f7 2018-05-02 06:14:57,225 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:57,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 06:14:57,240 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12798.seqid, newMaxSeqId=12798, maxSeqId=12797 2018-05-02 06:14:57,244 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12798 2018-05-02 06:14:57,247 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12416.seqid, newMaxSeqId=12416, maxSeqId=12415 2018-05-02 06:14:57,251 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 26d4b78c3c7d2fdea4d32bb21a3ca5fe; next sequenceid=12416 2018-05-02 06:14:57,252 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:14:57,253 INFO [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:14:57,255 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:14:57,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:57,256 DEBUG [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:14:57,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:58,864 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:14:58,876 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:14:58,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:14:58,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 3b0ff50ae790418c1d7b36d704a3c7a8, NAME => 'test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:14:58,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:14:58,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AuthenticationService 2018-05-02 06:14:58,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:58,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:58,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:14:58,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=SecureBulkLoadService 2018-05-02 06:14:58,881 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:58,881 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:58,881 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:58,881 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:58,881 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:58,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AccessControlService 2018-05-02 06:14:58,882 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:58,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:58,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:14:58,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:14:58,883 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:58,881 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:58,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:14:58,884 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:58,884 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:58,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:14:58,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:14:58,885 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:58,894 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:14:58,894 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:14:58,895 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:58,895 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:58,897 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:14:58,897 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:14:58,899 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:58,899 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:58,932 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:14:58,932 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:59,034 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:14:59,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:14:59,067 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:14:59,067 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:59,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:14:59,072 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 3b0ff50ae790418c1d7b36d704a3c7a8; next sequenceid=411 2018-05-02 06:14:59,074 INFO [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:14:59,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:14:59,078 DEBUG [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:14:59,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:14:59,097 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:14:59,101 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=417 2018-05-02 06:14:59,103 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:14:59,107 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:14:59,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:15:00,898 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:15:00,910 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:15:00,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:15:00,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:15:00,911 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:15:00,911 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:15:00,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:15:00,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:15:00,911 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:15:00,911 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:15:00,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:15:00,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,914 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:15:00,915 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:15:00,917 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:15:00,924 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:15:00,924 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:15:00,924 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:15:00,925 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:15:00,952 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:15:00,952 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:15:00,957 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:15:00,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12537.seqid, newMaxSeqId=12537, maxSeqId=12536 2018-05-02 06:15:00,981 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12537 2018-05-02 06:15:00,984 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,988 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,988 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:15:01,123 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:01,140 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:15:01,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:15:01,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:15:01,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:15:01,141 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:15:01,141 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:15:01,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:15:01,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:15:01,141 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:15:01,141 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:15:01,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:15:01,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:01,142 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:01,151 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:15:01,151 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:15:01,152 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:15:01,152 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:15:01,168 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:15:01,168 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:15:01,173 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:15:01,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12160.seqid, newMaxSeqId=12160, maxSeqId=12159 2018-05-02 06:15:01,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12160 2018-05-02 06:15:01,204 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:01,207 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:01,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:15:01,421 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:15:01,604 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:15:01,605 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:15:01,671 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:15:01,671 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:15:01,671 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:15:01,677 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:15:01,678 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:15:01,678 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:01,926 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:15:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:15:01,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:15:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:15:01,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:15:01,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:15:01,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:15:01,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:15:01,940 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:15:01,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:15:01,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:15:01,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:01,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:01,950 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:15:01,950 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:15:01,951 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=413, currentSize=25.52 MB, freeSize=179.28 MB, maxSize=204.80 MB, heapSize=25.52 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:15:01,951 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:15:01,968 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:15:01,968 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:15:01,973 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:15:01,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12240.seqid, newMaxSeqId=12240, maxSeqId=12239 2018-05-02 06:15:01,998 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12240 2018-05-02 06:15:02,000 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:02,006 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:02,006 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:15:04,355 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:04,355 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:04,355 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:04,366 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:04,367 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:04,368 DEBUG [RS-EventLoopGroup-1-54] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:05,912 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:15:05,913 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:15:05,915 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:15:06,420 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:15:06,697 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:15:06,698 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:15:06,788 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:15:06,788 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:15:06,788 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:15:06,795 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:15:06,798 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:15:06,798 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:13,219 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:13,219 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:13,219 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:13,231 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:13,232 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:13,232 DEBUG [RS-EventLoopGroup-1-55] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:14,319 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:14,319 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:14,319 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:14,338 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:14,340 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:14,340 DEBUG [RS-EventLoopGroup-1-56] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:17,807 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:17,807 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:17,807 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:17,848 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:17,849 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:17,850 DEBUG [RS-EventLoopGroup-1-57] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:26,426 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:26,426 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:26,426 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:26,447 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:26,449 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:26,449 DEBUG [RS-EventLoopGroup-1-58] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:28,718 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=25.52 MB, freeSize=179.28 MB, max=204.80 MB, blockCount=413, accesses=1271, hits=780, hitRatio=61.37%, , cachingAccesses=1209, cachingHits=732, cachingHitsRatio=60.55%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 06:15:33,029 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=34, succcessCount=11, totalEvents=1255344, totalSuccessCount=78741 2018-05-02 06:15:35,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=6, created chunk count=53, reused chunk count=10, reuseRatio=15.87% 2018-05-02 06:15:35,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:15:37,031 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:37,031 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,032 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:37,049 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,050 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:37,051 DEBUG [RS-EventLoopGroup-1-59] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:37,414 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:37,414 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,414 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:37,429 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:37,431 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:37,431 DEBUG [RS-EventLoopGroup-1-60] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:42,906 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:42,906 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:42,907 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:42,950 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:42,951 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:42,952 DEBUG [RS-EventLoopGroup-1-61] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:48,381 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:48,382 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:48,382 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:48,399 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:48,400 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:48,400 DEBUG [RS-EventLoopGroup-1-62] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:58,856 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:58,856 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:58,856 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:58,881 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:58,882 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:58,882 DEBUG [RS-EventLoopGroup-1-63] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:59,329 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:59,329 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,329 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:59,340 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,342 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:59,342 DEBUG [RS-EventLoopGroup-1-64] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:59,411 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:59,411 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,412 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:59,422 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,423 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:59,424 DEBUG [RS-EventLoopGroup-1-1] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:16:47,140 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:16:47,141 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:16:47,148 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:16:47,654 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:16:48,068 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:16:48,068 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:16:48,157 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:16:48,157 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:16:48,157 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:16:48,180 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:16:48,187 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:16:48,187 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:19:32,516 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:19:32,517 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:19:32,517 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:19:32,519 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:19:32,521 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:19:32,521 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:19:32,522 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:19:32,522 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:19:32,522 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:19:40,409 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:19:40,410 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1456ms. 2018-05-02 06:19:41,869 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 1556ms. 2018-05-02 06:19:43,427 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 4265ms. 2018-05-02 06:19:47,694 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 6930ms. 2018-05-02 06:19:54,626 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 22026ms. 2018-05-02 06:19:55,727 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 144513ms 2018-05-02 06:20:06,387 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 2305ms 2018-05-02 06:20:15,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 270187ms 2018-05-02 06:20:16,654 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 14171ms. 2018-05-02 06:20:25,680 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 74938ms 2018-05-02 06:20:28,719 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=25.78 MB, freeSize=179.02 MB, max=204.80 MB, blockCount=443, accesses=1341, hits=820, hitRatio=61.15%, , cachingAccesses=1279, cachingHits=772, cachingHitsRatio=60.36%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 06:20:30,827 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 21269ms. 2018-05-02 06:20:35,762 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 220594ms 2018-05-02 06:20:35,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=6, created chunk count=53, reused chunk count=10, reuseRatio=15.87% 2018-05-02 06:20:35,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:20:46,189 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 73989ms 2018-05-02 06:20:52,114 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 8964ms. 2018-05-02 06:20:56,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 50094ms 2018-05-02 06:21:01,095 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1081667817_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1081667817_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 16089ms. 2018-05-02 06:21:05,957 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 282701ms 2018-05-02 06:21:16,159 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 187474ms 2018-05-02 06:21:17,191 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1081667817_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1081667817_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 11607ms. 2018-05-02 06:21:25,850 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 231860ms 2018-05-02 06:21:35,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 240615ms 2018-05-02 06:21:46,391 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 290154ms 2018-05-02 06:21:47,140 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:21:47,141 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:21:47,145 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:21:47,648 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:21:47,850 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:21:47,850 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:21:47,924 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:21:47,924 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:21:47,924 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:21:47,930 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:21:47,932 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:21:47,932 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:21:55,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 91814ms 2018-05-02 06:22:05,668 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 99092ms 2018-05-02 06:22:15,669 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 251470ms 2018-05-02 06:22:20,241 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:22:20,242 DEBUG [MemStoreFlusher.1] regionserver.FlushAllLargeStoresPolicy: Since none of the CFs were above the size, flushing all. 2018-05-02 06:22:20,243 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 2/2 column families, memstore data size=62.85 KB memstore heap size=91.88 KB 2018-05-02 06:22:20,339 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=62.85 KB at sequenceid=1711 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/31a7c33905044646bcea6fa736af60dc 2018-05-02 06:22:20,425 INFO [MemStoreFlusher.1] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:22:20,437 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/31a7c33905044646bcea6fa736af60dc as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/31a7c33905044646bcea6fa736af60dc 2018-05-02 06:22:20,467 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/31a7c33905044646bcea6fa736af60dc, entries=330, sequenceid=1711, filesize=58.8 K 2018-05-02 06:22:20,470 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~62.85 KB/64361, heap size ~92.51 KB/94728, currentsize=0 B/0 for 1588230740 in 228ms, sequenceid=1711, compaction requested=false 2018-05-02 06:22:24,049 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=07:57.022 minutes, events=12, succcessCount=12, totalEvents=78741, totalSuccessCount=78741 2018-05-02 06:22:33,049 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=2, succcessCount=1, totalEvents=1255346, totalSuccessCount=78742 2018-05-02 06:23:53,442 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,443 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:23:53,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,445 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,446 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:23:53,449 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:23:53,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:23:53,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:23:53,453 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/8 2018-05-02 06:23:53,453 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,482 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:23:53,487 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 znode expired, triggering replicatorRemoved event 2018-05-02 06:23:53,487 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:23:53,670 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:23:53,673 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:23:53,673 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:53,675 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:23:53,677 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:53,677 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:23:53,677 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:53,677 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:23:53,678 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:23:54,034 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:23:54,037 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:23:54,037 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,039 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:23:54,040 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,040 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:23:54,041 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:23:54,045 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:54,062 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:54,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:23:54,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 06:23:54,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 06:23:54,064 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,065 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 06:23:54,065 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:23:54,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:54,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 84e1f06e5813d24f1cc300fb32167710, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:23:54,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AuthenticationService 2018-05-02 06:23:54,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=SecureBulkLoadService 2018-05-02 06:23:54,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AccessControlService 2018-05-02 06:23:54,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:23:54,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:54,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,078 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:23:54,078 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:23:54,079 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:54,080 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,080 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,097 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:23:54,097 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:23:54,097 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,098 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,099 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:54,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:23:54,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:23:54,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:23:54,102 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,102 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:23:54,102 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:23:54,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:54,115 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:23:54,116 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:23:54,116 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,117 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,118 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:23:54,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 06:23:54,119 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:23:54,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 06:23:54,119 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:23:54,119 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:23:54,119 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:23:54,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 06:23:54,120 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:23:54,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:23:54,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:23:54,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:54,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:54,134 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:23:54,134 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1/55f6b92d148746a78237d661d14075ef 2018-05-02 06:23:54,134 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,134 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,145 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:23:54,145 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:23:54,146 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:23:54,147 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:23:54,151 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:23:54,158 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:23:54,161 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:23:54,161 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:23:54,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:23:54,194 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 06:23:54,194 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:23:54,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:23:54,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=411 2018-05-02 06:23:54,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:23:54,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 84e1f06e5813d24f1cc300fb32167710; next sequenceid=408 2018-05-02 06:23:54,216 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:54,216 INFO [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:54,221 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:54,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:23:54,222 DEBUG [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:54,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:23:54,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/34.seqid, newMaxSeqId=34, maxSeqId=33 2018-05-02 06:23:54,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=34 2018-05-02 06:23:54,243 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:54,251 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:54,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:23:54,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12465.seqid, newMaxSeqId=12465, maxSeqId=12464 2018-05-02 06:23:54,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12465 2018-05-02 06:23:54,275 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:54,279 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:54,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:23:54,869 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:23:57,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:33.003 minutes, events=1, succcessCount=1, totalEvents=78742, totalSuccessCount=78742 2018-05-02 06:23:59,066 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:23:59,067 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:23:59,071 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:23:59,575 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:23:59,943 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:23:59,944 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:24:00,045 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:24:00,045 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:00,045 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:00,051 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:00,054 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:00,054 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:30,460 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:24:33,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=6, succcessCount=3, totalEvents=1255352, totalSuccessCount=78745 2018-05-02 06:24:51,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62." 2018-05-02 06:24:51,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 3bbeffd33dfc99ea8862c8eae819df62, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:51,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538." 2018-05-02 06:24:51,394 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 60955ebb25dcf0aeb6d46e894a921538, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:51,395 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:51,395 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:51,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:24:51,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:24:51,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,395 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,413 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12467.seqid, newMaxSeqId=12467, maxSeqId=12465 2018-05-02 06:24:51,414 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/36.seqid, newMaxSeqId=36, maxSeqId=34 2018-05-02 06:24:51,417 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:51,417 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:51,417 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:51,417 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,417 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 3bbeffd33dfc99ea8862c8eae819df62 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=12465 2018-05-02 06:24:51,418 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:51,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:51,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:51,419 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,419 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding 60955ebb25dcf0aeb6d46e894a921538 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=34 2018-05-02 06:24:51,420 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,420 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:52,201 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\0245\345\ryC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334." 2018-05-02 06:24:52,201 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close fa24e8d8fdd999d38faae5dbf847c334, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:52,202 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\274\241\257(k\312\032\330,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8." 2018-05-02 06:24:52,202 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 3b0ff50ae790418c1d7b36d704a3c7a8, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:52,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:52,203 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:52,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing fa24e8d8fdd999d38faae5dbf847c334, disabling compactions & flushes 2018-05-02 06:24:52,203 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Running close preflush of {}fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:24:52,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3b0ff50ae790418c1d7b36d704a3c7a8, disabling compactions & flushes 2018-05-02 06:24:52,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,203 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=14.16 MB memstore heap size=30.98 MB 2018-05-02 06:24:52,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:24:52,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:52,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:52,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:52,249 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,249 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Adding 3b0ff50ae790418c1d7b36d704a3c7a8 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=411 2018-05-02 06:24:52,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,657 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=14.16 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/.tmp/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:24:52,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/.tmp/f1/f817097956b04d90a34738b22c734e7a as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:24:52,702 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a, entries=254149, sequenceid=404, filesize=14.0 M 2018-05-02 06:24:52,705 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~14.16 MB/14843352, heap size ~30.98 MB/32489112, currentsize=0 B/0 for fa24e8d8fdd999d38faae5dbf847c334 in 501ms, sequenceid=404, compaction requested=false 2018-05-02 06:24:52,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:52,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:24:52,735 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:52,735 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:52,735 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:52,735 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:52,736 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding fa24e8d8fdd999d38faae5dbf847c334 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=404 2018-05-02 06:24:52,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:53,421 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281." 2018-05-02 06:24:53,422 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close a6e0d7561c4f19e78f94d37462588281, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:24:53,423 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:53,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:24:53,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13475.seqid, newMaxSeqId=13475, maxSeqId=13473 2018-05-02 06:24:53,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:53,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:53,452 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:53,452 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,453 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding a6e0d7561c4f19e78f94d37462588281 move to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 record at close sequenceid=13473 2018-05-02 06:24:53,456 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:56,417 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:24:56,418 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:24:56,419 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:24:56,922 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:57,054 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=7, succcessCount=7, totalEvents=78749, totalSuccessCount=78749 2018-05-02 06:24:57,167 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:57,167 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:24:57,240 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:24:57,240 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:57,240 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:57,247 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:57,249 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:57,249 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:57,785 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:24:57,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:24:57,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:24:57,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:57,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:24:57,804 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:57,804 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:57,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:57,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:24:57,804 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:57,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:57,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:24:57,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:24:57,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:57,817 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:24:57,817 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:24:57,818 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:57,819 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:57,840 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:24:57,841 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:57,847 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:24:57,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12798.seqid, newMaxSeqId=12798, maxSeqId=12797 2018-05-02 06:24:57,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12798 2018-05-02 06:24:57,955 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:24:57,958 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:24:57,958 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:02,805 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:25:02,806 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:25:02,808 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:03,312 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:03,544 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:03,544 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:25:03,632 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:25:03,632 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:03,632 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:03,640 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:03,644 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:03,644 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:28,718 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=25.78 MB, freeSize=179.02 MB, max=204.80 MB, blockCount=443, accesses=1462, hits=941, hitRatio=64.36%, , cachingAccesses=1400, cachingHits=893, cachingHitsRatio=63.79%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 06:25:29,438 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,439 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:25:29,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,442 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,442 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:29,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:25:29,451 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:25:29,452 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/9 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,458 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 2018-05-02 06:25:29,461 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 znode expired, triggering replicatorRemoved event 2018-05-02 06:25:29,461 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:25:29,945 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:25:29,961 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:25:29,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:25:29,963 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:25:29,963 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:29,963 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:29,963 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:29,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:25:29,964 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:29,964 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:29,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:25:29,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:25:29,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:29,992 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:25:29,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:25:29,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:25:29,993 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:29,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:25:29,993 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:29,993 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:29,993 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:29,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:25:29,993 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:25:29,993 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:29,993 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:25:29,993 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:29,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:25:29,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:25:29,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:29,994 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:29,995 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,008 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:25:30,008 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => b7a376d86459306e108ed5a76373661f, NAME => 'test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:25:30,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AuthenticationService 2018-05-02 06:25:30,009 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=SecureBulkLoadService 2018-05-02 06:25:30,009 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,009 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,009 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. service=AccessControlService 2018-05-02 06:25:30,009 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,009 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,010 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b7a376d86459306e108ed5a76373661f 2018-05-02 06:25:30,010 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:25:30,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,025 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:25:30,025 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:25:30,026 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,026 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,029 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:25:30,029 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:25:30,030 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:25:30,030 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:25:30,031 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:25:30,034 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:25:30,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 3ca34b6bdc72922097d54ce260dbd903, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:25:30,035 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AuthenticationService 2018-05-02 06:25:30,035 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => ab4e529620b9089675ab2d6f3446a39c, NAME => 'test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:25:30,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AuthenticationService 2018-05-02 06:25:30,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=SecureBulkLoadService 2018-05-02 06:25:30,036 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,036 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AccessControlService 2018-05-02 06:25:30,036 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:25:30,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:25:30,037 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=SecureBulkLoadService 2018-05-02 06:25:30,038 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,038 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:25:30,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 06:25:30,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 06:25:30,038 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,038 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AccessControlService 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => 8ac6e5d607af84df53c95bd38a03c313, NAME => 'test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 06:25:30,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 06:25:30,039 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,039 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 06:25:30,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:25:30,039 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:25:30,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:25:30,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,040 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 06:25:30,040 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1 2018-05-02 06:25:30,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 06:25:30,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 06:25:30,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 06:25:30,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,041 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 06:25:30,041 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,042 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 06:25:30,042 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AuthenticationService 2018-05-02 06:25:30,043 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=SecureBulkLoadService 2018-05-02 06:25:30,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. service=AccessControlService 2018-05-02 06:25:30,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:25:30,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:25:30,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 06:25:30,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 06:25:30,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:25:30,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:25:30,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:25:30,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:25:30,086 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:25:30,086 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:25:30,087 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,088 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,089 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:25:30,089 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:25:30,090 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:25:30,090 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1 2018-05-02 06:25:30,090 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,099 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,100 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,100 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,101 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:25:30,101 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:25:30,101 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,102 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,103 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 06:25:30,103 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 06:25:30,104 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:25:30,104 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 06:25:30,105 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,106 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,105 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,110 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,119 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:25:30,121 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,147 DEBUG [StoreOpener-b7a376d86459306e108ed5a76373661f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/f1/bae67c56562a4bec8f7072dec02c91fa 2018-05-02 06:25:30,150 INFO [StoreOpener-b7a376d86459306e108ed5a76373661f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:25:30,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12780.seqid, newMaxSeqId=12780, maxSeqId=12779 2018-05-02 06:25:30,203 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 06:25:30,203 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f 2018-05-02 06:25:30,218 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12780 2018-05-02 06:25:30,223 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 06:25:30,223 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,224 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:25:30,228 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 06:25:30,228 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,237 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:25:30,237 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,239 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 06:25:30,248 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/2a4d0a4a276a427f956af1d693600d04 2018-05-02 06:25:30,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 06:25:30,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:25:30,265 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/7e7819a9ed7b4762a10d8bb24cd6d15a 2018-05-02 06:25:30,274 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1/7914c5e37a8a4498ac542a00c9e38435 2018-05-02 06:25:30,274 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:25:30,303 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13001.seqid, newMaxSeqId=13001, maxSeqId=13000 2018-05-02 06:25:30,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:25:30,318 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/fbf50f6c80344b5190d76c6ce3b8f375 2018-05-02 06:25:30,318 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12300.seqid, newMaxSeqId=12300, maxSeqId=12299 2018-05-02 06:25:30,327 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened b7a376d86459306e108ed5a76373661f; next sequenceid=411 2018-05-02 06:25:30,336 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=13001 2018-05-02 06:25:30,337 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12300 2018-05-02 06:25:30,340 DEBUG [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/f1/952e6e0835fe40d8bf53e29e592d158c 2018-05-02 06:25:30,340 INFO [StoreOpener-8ac6e5d607af84df53c95bd38a03c313-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12751.seqid, newMaxSeqId=12751, maxSeqId=12750 2018-05-02 06:25:30,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12434.seqid, newMaxSeqId=12434, maxSeqId=12433 2018-05-02 06:25:30,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:25:30,348 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:25:30,349 INFO [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:25:30,350 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:25:30,352 DEBUG [PostOpenDeployTasks:b7a376d86459306e108ed5a76373661f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:25:30,352 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=12751 2018-05-02 06:25:30,352 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=12434 2018-05-02 06:25:30,352 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,352 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:25:30,352 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:25:30,353 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,354 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,374 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:25:30,375 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:25:30,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313 2018-05-02 06:25:30,376 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:25:30,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,377 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:25:30,378 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:25:30,403 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 3ca34b6bdc72922097d54ce260dbd903; next sequenceid=408 2018-05-02 06:25:30,405 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:25:30,409 INFO [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:25:30,412 DEBUG [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:25:30,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,414 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened ab4e529620b9089675ab2d6f3446a39c; next sequenceid=414 2018-05-02 06:25:30,418 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:25:30,418 INFO [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:25:30,423 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened 8ac6e5d607af84df53c95bd38a03c313; next sequenceid=417 2018-05-02 06:25:30,424 DEBUG [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:25:30,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:30,427 INFO [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:25:30,431 DEBUG [PostOpenDeployTasks:8ac6e5d607af84df53c95bd38a03c313] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:25:30,432 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:25:33,061 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=38, succcessCount=15, totalEvents=1255390, totalSuccessCount=78760 2018-05-02 06:25:34,964 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:25:34,965 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:25:34,968 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:35,471 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:35,717 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:35,717 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:25:35,811 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:25:35,812 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:35,812 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:35,821 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:35,823 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:35,823 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:35,949 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=14, created chunk count=53, reused chunk count=11, reuseRatio=17.19% 2018-05-02 06:25:35,950 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:26:00,803 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:47,140 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:26:47,141 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:26:47,143 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:26:47,647 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:26:48,030 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:26:48,030 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:26:48,107 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:26:48,107 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:26:48,108 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:26:48,115 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:26:48,116 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:26:48,116 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:26:56,689 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 2018-05-02 06:26:56,694 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 znode expired, triggering replicatorRemoved event 2018-05-02 06:26:56,694 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:57,047 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:26:57,089 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:26:57,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:26:57,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 06:26:57,090 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 06:26:57,090 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,090 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,090 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 06:26:57,090 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,090 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:26:57,091 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:26:57,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,108 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:26:57,108 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:26:57,109 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,109 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:26:57,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 06:26:57,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 06:26:57,120 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,120 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,120 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 06:26:57,120 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,120 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:26:57,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:26:57,121 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,122 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:26:57,122 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:26:57,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:26:57,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => cb06832d0afac8a9bdbe1f92ad565ab6, NAME => 'test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:26:57,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 06:26:57,123 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 06:26:57,123 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,123 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AuthenticationService 2018-05-02 06:26:57,123 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,123 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,123 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=SecureBulkLoadService 2018-05-02 06:26:57,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 06:26:57,127 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,127 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. service=AccessControlService 2018-05-02 06:26:57,128 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,128 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:26:57,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:26:57,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:26:57,129 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:26:57,129 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,136 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:26:57,136 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:26:57,136 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,137 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,138 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 06:26:57,138 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,144 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:26:57,144 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:26:57,145 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,145 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,147 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:26:57,147 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf 2018-05-02 06:26:57,148 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,148 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:26:57,179 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 06:26:57,179 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:26:57,195 DEBUG [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/test_cf/a27dcab7a55f4a778d0eb5f46f3095e2 2018-05-02 06:26:57,195 INFO [StoreOpener-cb06832d0afac8a9bdbe1f92ad565ab6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12892.seqid, newMaxSeqId=12892, maxSeqId=12891 2018-05-02 06:26:57,202 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6 2018-05-02 06:26:57,204 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=12892 2018-05-02 06:26:57,209 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:26:57,210 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 06:26:57,210 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12759.seqid, newMaxSeqId=12759, maxSeqId=12758 2018-05-02 06:26:57,212 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:26:57,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:26:57,224 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12759 2018-05-02 06:26:57,225 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:26:57,229 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:26:57,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12888.seqid, newMaxSeqId=12888, maxSeqId=12887 2018-05-02 06:26:57,234 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:26:57,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,243 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened cb06832d0afac8a9bdbe1f92ad565ab6; next sequenceid=12888 2018-05-02 06:26:57,248 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:26:57,248 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 298977e880ecf479f4c50be95a5e8eb5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:26:57,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AuthenticationService 2018-05-02 06:26:57,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,252 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=SecureBulkLoadService 2018-05-02 06:26:57,252 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,252 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,252 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AccessControlService 2018-05-02 06:26:57,253 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,253 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,253 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:26:57,253 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:26:57,253 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,254 INFO [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:26:57,255 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:26:57,256 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:26:57,256 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:26:57,256 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:26:57,256 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:26:57,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:26:57,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 06:26:57,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 06:26:57,260 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,260 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:26:57,261 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => b03e6835fbab67365568f0d2520e68de, NAME => 'test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:26:57,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => a3403d29839e289caca7a1e3c5cd71be, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:26:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AuthenticationService 2018-05-02 06:26:57,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:26:57,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=SecureBulkLoadService 2018-05-02 06:26:57,262 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,262 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 06:26:57,263 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 51119cebc42546d1c9f2590eec5a49b3, NAME => 'test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:26:57,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AuthenticationService 2018-05-02 06:26:57,263 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=SecureBulkLoadService 2018-05-02 06:26:57,263 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,263 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AccessControlService 2018-05-02 06:26:57,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 06:26:57,264 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,264 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 06:26:57,264 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 06:26:57,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:26:57,265 DEBUG [PostOpenDeployTasks:cb06832d0afac8a9bdbe1f92ad565ab6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:26:57,265 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AuthenticationService 2018-05-02 06:26:57,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 06:26:57,265 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,265 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=SecureBulkLoadService 2018-05-02 06:26:57,265 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,265 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,265 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,265 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,265 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,265 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12245.seqid, newMaxSeqId=12245, maxSeqId=12244 2018-05-02 06:26:57,265 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AccessControlService 2018-05-02 06:26:57,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,266 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AccessControlService 2018-05-02 06:26:57,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 06:26:57,277 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b03e6835fbab67365568f0d2520e68de 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:26:57,277 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:26:57,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:26:57,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:26:57,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=12245 2018-05-02 06:26:57,284 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:26:57,284 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:26:57,285 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,285 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,289 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:26:57,292 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:26:57,293 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,297 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:26:57,297 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:26:57,298 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:26:57,298 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:26:57,298 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:26:57,298 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:26:57,298 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,298 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,299 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,299 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,300 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,301 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,302 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:26:57,302 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:26:57,302 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:26:57,302 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:26:57,302 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,303 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,303 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,303 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,309 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:26:57,309 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:26:57,309 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=443, currentSize=25.78 MB, freeSize=179.02 MB, maxSize=204.80 MB, heapSize=25.78 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,310 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,340 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1/5dd531f9eb2a49a68712ee9638f0247b 2018-05-02 06:26:57,340 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,345 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:26:57,345 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,347 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:26:57,352 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:26:57,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de 2018-05-02 06:26:57,363 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 06:26:57,365 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:26:57,365 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,372 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:26:57,372 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,382 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:26:57,384 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:26:57,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 06:26:57,393 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:26:57,393 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,413 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:26:57,413 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,413 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:26:57,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:26:57,418 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:26:57,422 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 298977e880ecf479f4c50be95a5e8eb5; next sequenceid=408 2018-05-02 06:26:57,422 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 06:26:57,423 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,424 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened b03e6835fbab67365568f0d2520e68de; next sequenceid=411 2018-05-02 06:26:57,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:26:57,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:26:57,427 INFO [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:26:57,430 DEBUG [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:26:57,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 06:26:57,431 INFO [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:26:57,433 DEBUG [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:26:57,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,436 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:26:57,436 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=411 2018-05-02 06:26:57,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=414 2018-05-02 06:26:57,449 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:26:57,449 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:26:57,453 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:26:57,453 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:26:57,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:26:57,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,459 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened a3403d29839e289caca7a1e3c5cd71be; next sequenceid=414 2018-05-02 06:26:57,468 INFO [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:26:57,471 DEBUG [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:26:57,471 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,473 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:26:57,486 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:26:57,489 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=417 2018-05-02 06:26:57,494 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 51119cebc42546d1c9f2590eec5a49b3; next sequenceid=414 2018-05-02 06:26:57,494 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:26:57,500 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:26:57,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:26:57,513 INFO [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:26:57,516 DEBUG [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:26:57,516 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:27:02,091 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:27:02,092 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:27:02,094 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:27:02,597 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:27:02,825 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:27:02,826 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:27:02,905 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:27:02,905 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:27:02,905 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:27:02,912 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:27:02,914 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:27:02,915 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:27:03,063 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:06.009 minutes, events=11, succcessCount=11, totalEvents=78760, totalSuccessCount=78760 2018-05-02 06:27:30,729 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:27:36,065 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=8, succcessCount=4, totalEvents=1255398, totalSuccessCount=78764 Wed May 2 06:28:23 UTC 2018 Terminating regionserver 2018-05-02 06:28:23,260 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:28:23,260 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:28:23,261 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:28:23,261 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:28:23,261 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:28:23,261 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:28:23,261 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:28:23,262 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:28:23,262 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:28:23,263 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:28:23,263 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:28:23,263 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:28:23,263 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:20.200 minutes, events=4, succcessCount=4, totalEvents=78764, totalSuccessCount=78764 2018-05-02 06:28:23,263 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:28:23,263 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281' ***** 2018-05-02 06:28:23,263 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:28:23,263 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:28:23,264 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,265 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,265 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:28:23,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:28:23,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:28:23,267 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:28:23,267 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 exiting 2018-05-02 06:28:23,284 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:28:23,297 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:28:23,298 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:28:23,298 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:28:23,301 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:28:23,302 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:28:23,302 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:28:23,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:28:23,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:28:23,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:28:23,303 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:23,303 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 06:28:23,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:23,304 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 06:28:23,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:28:23,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,305 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,306 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,309 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,309 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,309 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,309 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,309 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,310 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,311 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,311 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,311 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,311 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,311 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:23,311 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:28:23,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x06c529c0 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:28:23,312 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:28:23,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:28:23,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:28:23,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:28:23,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,313 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,313 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:28:23,314 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:28:23,314 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=178.66 KB memstore heap size=260.74 KB 2018-05-02 06:28:23,314 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 47 regions to close 2018-05-02 06:28:23,568 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12800.seqid, newMaxSeqId=12800, maxSeqId=12798 2018-05-02 06:28:23,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:28:23,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12302.seqid, newMaxSeqId=12302, maxSeqId=12300 2018-05-02 06:28:23,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,579 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:28:23,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,581 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:23,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:28:23,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:23,582 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 06:28:23,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:28:23,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:23,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:23,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,584 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b32f7e3b20e736fd1681093bef6b435d, disabling compactions & flushes 2018-05-02 06:28:23,584 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:23,584 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=774.06 KB memstore heap size=1.66 MB 2018-05-02 06:28:23,642 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=178.66 KB at sequenceid=2018 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/6de8640fbdc24fdba5ef1af5f6ed32f1 2018-05-02 06:28:23,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12436.seqid, newMaxSeqId=12436, maxSeqId=12434 2018-05-02 06:28:23,653 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12782.seqid, newMaxSeqId=12782, maxSeqId=12780 2018-05-02 06:28:23,653 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,653 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,654 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:28:23,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 06:28:23,655 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing b03e6835fbab67365568f0d2520e68de, disabling compactions & flushes 2018-05-02 06:28:23,656 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:23,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,664 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:23,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:28:23,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:28:23,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:28:23,680 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/6de8640fbdc24fdba5ef1af5f6ed32f1 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/6de8640fbdc24fdba5ef1af5f6ed32f1 2018-05-02 06:28:23,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:28:23,693 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,694 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,694 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,694 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:23,694 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:28:23,694 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,694 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 47c574242e461d8e7a12972718bc27ff, disabling compactions & flushes 2018-05-02 06:28:23,695 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:28:23,712 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=774.06 KB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/.tmp/f1/aca5a68c0e414fe7b1239ba0d951dc5f 2018-05-02 06:28:23,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:23,715 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/6de8640fbdc24fdba5ef1af5f6ed32f1, entries=952, sequenceid=2018, filesize=162.3 K 2018-05-02 06:28:23,720 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~178.66 KB/182946, heap size ~261.59 KB/267864, currentsize=0 B/0 for 1588230740 in 406ms, sequenceid=2018, compaction requested=true 2018-05-02 06:28:23,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,724 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:28:23,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:28:23,725 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,725 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 06:28:23,725 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:28:23,732 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:28:23,743 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/.tmp/f1/aca5a68c0e414fe7b1239ba0d951dc5f as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/aca5a68c0e414fe7b1239ba0d951dc5f 2018-05-02 06:28:23,747 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,747 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,747 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,747 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:28:23,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:28:23,749 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 06:28:23,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:23,752 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2021.seqid, newMaxSeqId=2021, maxSeqId=1441 2018-05-02 06:28:23,756 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12193.seqid, newMaxSeqId=12193, maxSeqId=12191 2018-05-02 06:28:23,760 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,760 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:28:23,760 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,760 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,761 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 06:28:23,761 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 06:28:23,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,764 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:28:23,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:28:23,765 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:28:23,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:23,780 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12894.seqid, newMaxSeqId=12894, maxSeqId=12892 2018-05-02 06:28:23,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,785 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:23,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:23,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 06:28:23,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:28:23,799 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/f1/aca5a68c0e414fe7b1239ba0d951dc5f, entries=13611, sequenceid=407, filesize=786.6 K 2018-05-02 06:28:23,805 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~774.06 KB/792639, heap size ~1.66 MB/1740192, currentsize=0 B/0 for b32f7e3b20e736fd1681093bef6b435d in 220ms, sequenceid=407, compaction requested=false 2018-05-02 06:28:23,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:28:23,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,816 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:23,816 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:23,816 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,817 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 89df5caac424c7424fede4183c6dce19, disabling compactions & flushes 2018-05-02 06:28:23,817 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:28:23,831 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12247.seqid, newMaxSeqId=12247, maxSeqId=12245 2018-05-02 06:28:23,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:28:23,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:28:23,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 3ca34b6bdc72922097d54ce260dbd903, disabling compactions & flushes 2018-05-02 06:28:23,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:23,863 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b32f7e3b20e736fd1681093bef6b435d/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:28:23,871 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:23,872 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,872 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,872 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,872 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:23,872 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD0\xD7\x945\xE5\x0Dy&,1525241408832.b32f7e3b20e736fd1681093bef6b435d. 2018-05-02 06:28:23,873 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,873 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 06:28:23,873 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:28:23,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,878 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:28:23,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:28:23,878 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:28:23,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:23,885 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:28:23,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,900 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:23,901 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:28:23,901 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,901 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 06:28:23,901 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:28:23,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12850.seqid, newMaxSeqId=12850, maxSeqId=12848 2018-05-02 06:28:23,927 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12800.seqid, newMaxSeqId=12800, maxSeqId=12798 2018-05-02 06:28:23,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12753.seqid, newMaxSeqId=12753, maxSeqId=12751 2018-05-02 06:28:23,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,937 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:28:23,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:28:23,937 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:28:23,938 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:23,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,939 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:23,939 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:23,940 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 06:28:23,940 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:23,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:28:23,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 06:28:23,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 84e1f06e5813d24f1cc300fb32167710, disabling compactions & flushes 2018-05-02 06:28:23,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:28:23,960 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:23,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12719.seqid, newMaxSeqId=12719, maxSeqId=12717 2018-05-02 06:28:23,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:28:23,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:23,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:23,965 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 06:28:23,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:28:23,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,966 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:23,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:28:23,966 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 8cb8f1e8202d0fae01b5300bd7c59bcb, disabling compactions & flushes 2018-05-02 06:28:23,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:23,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:23,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:23,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:23,967 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:28:23,967 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:28:23,968 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:23,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 32b24a1d0ec05868d69a34a41559e784, disabling compactions & flushes 2018-05-02 06:28:23,968 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Running close preflush of {}32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:28:23,968 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.93 MB memstore heap size=30.48 MB 2018-05-02 06:28:23,994 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:24,000 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12761.seqid, newMaxSeqId=12761, maxSeqId=12759 2018-05-02 06:28:24,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,005 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:24,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:24,006 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 685781049fdcc89efe3561b69e4d3810, disabling compactions & flushes 2018-05-02 06:28:24,006 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:28:24,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,012 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:28:24,012 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:28:24,013 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a3403d29839e289caca7a1e3c5cd71be, disabling compactions & flushes 2018-05-02 06:28:24,013 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:24,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:28:24,038 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:24,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,042 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:28:24,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:28:24,043 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 26d4b78c3c7d2fdea4d32bb21a3ca5fe, disabling compactions & flushes 2018-05-02 06:28:24,043 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:28:24,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,045 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:24,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:28:24,046 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 06:28:24,046 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:24,068 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12418.seqid, newMaxSeqId=12418, maxSeqId=12416 2018-05-02 06:28:24,074 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,074 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,074 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,074 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:28:24,074 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 06:28:24,074 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,075 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 70ed82a86a0f0c62d692e8ffd1c0f904, disabling compactions & flushes 2018-05-02 06:28:24,075 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Running close preflush of {}70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:28:24,075 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.99 MB memstore heap size=30.62 MB 2018-05-02 06:28:24,078 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12242.seqid, newMaxSeqId=12242, maxSeqId=12240 2018-05-02 06:28:24,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,082 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:24,082 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:24,083 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,083 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing e8edde5a00b30c080b02d1b096794b39, disabling compactions & flushes 2018-05-02 06:28:24,083 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Running close preflush of {}e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:28:24,083 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.91 MB memstore heap size=30.44 MB 2018-05-02 06:28:24,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 19 regions to close 2018-05-02 06:28:24,640 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.93 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/.tmp/f1/25e6dd3bb4da4a4da1bd529eeab4af61 2018-05-02 06:28:24,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/.tmp/f1/25e6dd3bb4da4a4da1bd529eeab4af61 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1/25e6dd3bb4da4a4da1bd529eeab4af61 2018-05-02 06:28:24,700 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1/25e6dd3bb4da4a4da1bd529eeab4af61, entries=249998, sequenceid=404, filesize=13.8 M 2018-05-02 06:28:24,706 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~13.93 MB/14604708, heap size ~30.48 MB/31958456, currentsize=0 B/0 for 32b24a1d0ec05868d69a34a41559e784 in 738ms, sequenceid=404, compaction requested=false 2018-05-02 06:28:24,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:28:24,869 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:28:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,876 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:28:24,877 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:28:24,877 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 46af8f9145c39f07531ceaa92c7f8dbc, disabling compactions & flushes 2018-05-02 06:28:24,878 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:24,909 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:24,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,914 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:24,914 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:24,914 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,915 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing d5e9f3919d5e95ad2d6e01e1e16fa8ad, disabling compactions & flushes 2018-05-02 06:28:24,915 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:24,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:28:24,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:24,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:24,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:24,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:24,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:24,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:24,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a47cc34ca47759b3fd7bcaa79faebd3d, disabling compactions & flushes 2018-05-02 06:28:24,965 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Running close preflush of {}a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:28:24,965 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.99 MB memstore heap size=30.62 MB 2018-05-02 06:28:25,012 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.99 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/.tmp/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:28:25,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/.tmp/f1/8d2cf3534de147ed904b9fc82a8f2b3b as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:28:25,042 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.91 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/.tmp/f1/977dea08c07d4c3986cb36260a1abca4 2018-05-02 06:28:25,058 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/.tmp/f1/977dea08c07d4c3986cb36260a1abca4 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1/977dea08c07d4c3986cb36260a1abca4 2018-05-02 06:28:25,064 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b, entries=251142, sequenceid=404, filesize=13.9 M 2018-05-02 06:28:25,070 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~13.99 MB/14671908, heap size ~30.62 MB/32104888, currentsize=0 B/0 for 70ed82a86a0f0c62d692e8ffd1c0f904 in 995ms, sequenceid=404, compaction requested=false 2018-05-02 06:28:25,070 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:25,085 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1/977dea08c07d4c3986cb36260a1abca4, entries=249681, sequenceid=404, filesize=13.8 M 2018-05-02 06:28:25,087 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.91 MB/14582308, heap size ~30.44 MB/31917880, currentsize=0 B/0 for e8edde5a00b30c080b02d1b096794b39 in 1004ms, sequenceid=404, compaction requested=false 2018-05-02 06:28:25,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:28:25,088 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:28:25,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,093 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:25,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:25,093 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 8ac6e5d607af84df53c95bd38a03c313, disabling compactions & flushes 2018-05-02 06:28:25,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:28:25,110 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:28:25,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8ac6e5d607af84df53c95bd38a03c313/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:28:25,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,115 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:28:25,115 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:28:25,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:28:25,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,117 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525239890069.8ac6e5d607af84df53c95bd38a03c313. 2018-05-02 06:28:25,117 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing ab4e529620b9089675ab2d6f3446a39c, disabling compactions & flushes 2018-05-02 06:28:25,117 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:28:25,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12162.seqid, newMaxSeqId=12162, maxSeqId=12160 2018-05-02 06:28:25,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:25,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,138 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:25,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:25,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 06:28:25,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:28:25,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,142 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:28:25,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:28:25,143 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 735c68afadbe039ceafe7e37c71a82b8, disabling compactions & flushes 2018-05-02 06:28:25,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:25,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:25,163 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12539.seqid, newMaxSeqId=12539, maxSeqId=12537 2018-05-02 06:28:25,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,167 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:25,167 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:25,168 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:28:25,168 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:28:25,169 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,170 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,170 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,170 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:28:25,173 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:28:25,174 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,174 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 54c783f1faee76bcce84aee6145e82d1, disabling compactions & flushes 2018-05-02 06:28:25,174 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:28:25,174 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.14 MB memstore heap size=4.69 MB 2018-05-02 06:28:25,190 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13003.seqid, newMaxSeqId=13003, maxSeqId=13001 2018-05-02 06:28:25,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,195 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:28:25,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:28:25,195 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing bcf3e62f0ae8e672bee1318720d62930, disabling compactions & flushes 2018-05-02 06:28:25,196 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Running close preflush of {}bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:28:25,196 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.92 MB memstore heap size=30.47 MB 2018-05-02 06:28:25,312 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.14 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/.tmp/f1/accb28f8bfa44c80a458ea61bfad3c0c 2018-05-02 06:28:25,340 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/.tmp/f1/accb28f8bfa44c80a458ea61bfad3c0c as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/accb28f8bfa44c80a458ea61bfad3c0c 2018-05-02 06:28:25,373 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/accb28f8bfa44c80a458ea61bfad3c0c, entries=38436, sequenceid=407, filesize=2.2 M 2018-05-02 06:28:25,377 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~2.14 MB/2244390, heap size ~4.69 MB/4913704, currentsize=0 B/0 for 54c783f1faee76bcce84aee6145e82d1 in 203ms, sequenceid=407, compaction requested=false 2018-05-02 06:28:25,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:28:25,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,419 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:28:25,420 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:28:25,420 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,421 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing cb06832d0afac8a9bdbe1f92ad565ab6, disabling compactions & flushes 2018-05-02 06:28:25,421 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:28:25,437 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 7 regions to close 2018-05-02 06:28:25,437 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Online Regions={a47cc34ca47759b3fd7bcaa79faebd3d=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d., bcf3e62f0ae8e672bee1318720d62930=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930., cb06832d0afac8a9bdbe1f92ad565ab6=test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6., 51119cebc42546d1c9f2590eec5a49b3=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3., b7a376d86459306e108ed5a76373661f=test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f., 298977e880ecf479f4c50be95a5e8eb5=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5., 94f6ca283dbb4445b2bcdc321b734d28=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.} 2018-05-02 06:28:25,459 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/cb06832d0afac8a9bdbe1f92ad565ab6/recovered.edits/12890.seqid, newMaxSeqId=12890, maxSeqId=12888 2018-05-02 06:28:25,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,466 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,466 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:28:25,470 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,e147ae02,1525237868269.cb06832d0afac8a9bdbe1f92ad565ab6. 2018-05-02 06:28:25,470 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 51119cebc42546d1c9f2590eec5a49b3, disabling compactions & flushes 2018-05-02 06:28:25,471 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:28:25,685 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.leaseChecker] regionserver.Leases: Closed leases 2018-05-02 06:28:25,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:28:25,738 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.99 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/.tmp/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:28:25,741 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,741 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,741 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,741 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:28:25,741 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:28:25,742 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b7a376d86459306e108ed5a76373661f, disabling compactions & flushes 2018-05-02 06:28:25,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:28:25,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b7a376d86459306e108ed5a76373661f/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:28:25,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/.tmp/f1/fd27d9b977b54177a8fb19407a54184c as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:28:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,782 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:28:25,783 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xC3^P\xD7\x945\xE4\xF2,1525239890069.b7a376d86459306e108ed5a76373661f. 2018-05-02 06:28:25,783 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,783 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 298977e880ecf479f4c50be95a5e8eb5, disabling compactions & flushes 2018-05-02 06:28:25,783 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:25,809 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c, entries=251161, sequenceid=404, filesize=13.9 M 2018-05-02 06:28:25,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:28:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,814 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:25,814 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:28:25,814 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:25,815 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 06:28:25,815 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:28:25,815 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Finished memstore flush; data size ~13.99 MB/14673220, heap size ~30.62 MB/32107064, currentsize=0 B/0 for a47cc34ca47759b3fd7bcaa79faebd3d in 850ms, sequenceid=404, compaction requested=false 2018-05-02 06:28:25,815 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:28:25,837 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13410.seqid, newMaxSeqId=13410, maxSeqId=13408 2018-05-02 06:28:25,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:28:25,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,843 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:28:25,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:28:25,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:28:25,847 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:28:25,902 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.92 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/.tmp/f1/a3522ed3bfda433db7a713973ceaf88b 2018-05-02 06:28:25,920 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/.tmp/f1/a3522ed3bfda433db7a713973ceaf88b as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1/a3522ed3bfda433db7a713973ceaf88b 2018-05-02 06:28:25,941 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1/a3522ed3bfda433db7a713973ceaf88b, entries=249962, sequenceid=404, filesize=13.8 M 2018-05-02 06:28:25,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Finished memstore flush; data size ~13.92 MB/14593672, heap size ~30.47 MB/31953816, currentsize=0 B/0 for bcf3e62f0ae8e672bee1318720d62930 in 747ms, sequenceid=404, compaction requested=false 2018-05-02 06:28:25,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:28:25,982 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:28:25,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:28:25,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:28:25,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:25,987 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:28:25,987 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:28:26,039 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281; all regions closed. 2018-05-02 06:28:26,039 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:26,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:28:26,065 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281.meta:.meta(num 1525241201874) 2018-05-02 06:28:26,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:26,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:28:26,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525241125281:(num 1525241139164) 2018-05-02 06:28:26,108 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:28:26,109 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 06:28:26,110 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:28:26,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:28:26,122 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 06:28:26,122 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:28:26,122 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:28:26,166 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:26,167 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939009d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:28:26,178 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x2631f08d939009d closed 2018-05-02 06:28:26,178 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:28:26,178 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281; zookeeper connection closed. 2018-05-02 06:28:26,178 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:28:26,179 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:28:45 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:28:47,209 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:28:47,211 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:28:47,211 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:28:47,212 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:28:47,212 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:28:47,707 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:28:47,707 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:28:47,707 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:28:47,707 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:28:47,709 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:28:47,709 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:28:47,709 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:28:47,709 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:28:47,709 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:28:47,710 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020628 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:28:47,711 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:28:47,712 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:28:47,713 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020628 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:28:47,714 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:28:47,715 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:28:47,715 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:28:47,715 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:28:47,717 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:28:47,717 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020628, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:28:47,899 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:28:48,401 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:28:48,450 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:28:48,928 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:28:48,932 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:28:49,370 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:28:49,371 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:28:49,371 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:28:49,427 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:28:49,612 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:28:49,612 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:28:49,659 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:28:50,059 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 06:28:50,089 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:28:50,100 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:28:50,101 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:28:50,101 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:28:50,105 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:28:50,105 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:28:50,297 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:28:50,542 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:28:50,559 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:28:50,717 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 06:28:50,871 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:28:50,875 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:28:50,878 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:28:50,891 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:50,893 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:50,899 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:28:52,459 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:28:52,478 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:28:52,563 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:28:52,572 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:28:52,572 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:28:52,572 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:28:52,572 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:28:52,572 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:28:52,573 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:28:52,574 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:28:52,575 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:28:52,610 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:28:52,616 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:28:52,623 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:28:52,627 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:28:52 UTC 2018 2018-05-02 06:28:52,627 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:28:52 UTC 2018 2018-05-02 06:28:52,627 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:36:36 UTC 2018 2018-05-02 06:28:52,629 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:28:52,639 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:28:52,650 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900bf, negotiated timeout = 90000 2018-05-02 06:28:52,653 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:28:52,654 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf connected 2018-05-02 06:28:52,685 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:28:52,755 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:28:52,755 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:28:52,755 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:28:52,755 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:28:52,755 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:28:52,756 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:28:52,756 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:28:52,756 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:28:52,756 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:28:52,756 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:28:52,761 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:28:52,816 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:28:52,819 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:28:52,820 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:28:52,825 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:28:52,831 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:28:52,899 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:28:52,899 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:28:52,900 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:28:52,945 INFO [main] util.log: Logging initialized @6671ms 2018-05-02 06:28:53,080 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:28:53,105 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:28:53,106 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:28:53,110 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:28:53,111 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:28:53,111 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:28:53,164 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:28:53,167 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:28:53,231 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:28:53,232 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:28:53,474 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:28:53,481 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:28:53,496 INFO [main] server.AbstractConnector: Started ServerConnector@60fef5e7{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:28:53,496 INFO [main] server.Server: Started @7223ms 2018-05-02 06:28:53,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:28:53,544 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:28:53,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:28:53,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:28:53,574 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:28:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x3aa18365 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:28:53,634 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1235755423@caab6ce 2018-05-02 06:28:53,636 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:28:53,637 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:28:53,637 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:28:53,641 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900c0, negotiated timeout = 90000 2018-05-02 06:28:53,697 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b6d7b24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:28:53,700 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24850288, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 06:28:53,710 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 06:28:53,729 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:28:53,729 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:28:53,752 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:28:53,753 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:28:53,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:28:53,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:28:53,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:28:53,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:28:54,000 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:28:54,004 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:28:54,009 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:28:54,010 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:28:54,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:28:54,015 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:28:54,070 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:28:54,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:28:54,073 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:28:54,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:28:54,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:28:54,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:28:54,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:28:54,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:28:54,087 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:28:54,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:28:54,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:28:54,088 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:28:54,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:28:54,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:28:54,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:28:54,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:28:54,151 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:28:54,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:28:54,207 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:28:54,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:28:54,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:28:54,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:28:54,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:28:54,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:28:54,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:28:54,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:28:54,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:28:54,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:28:54,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:28:54,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:28:54,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:28:54,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:28:54,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:28:54,222 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:28:54,222 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:28:54,222 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:28:54,222 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:28:54,224 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:28:54,224 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:28:54,224 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:28:54,224 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:28:54,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:28:54,226 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:28:54,227 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:28:54,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:28:54,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:28:54,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:28:54,228 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:28:54,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:28:54,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:28:54,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:28:54,239 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:28:54,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:28:54,467 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:28:54,794 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:28:56,902 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:28:57,090 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:28:57,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:28:57,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:28:57,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:28:57,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:28:57,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525241326264 with port=16020, startcode=1525242527751 2018-05-02 06:28:57,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:28:57,239 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:28:57,242 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:28:57,354 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:28:57,373 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:28:57,403 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:28:57,406 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:28:57,407 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:28:57,424 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:28:57,424 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:28:57,476 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:28:57,476 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:28:57,476 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:28:57,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:28:57,561 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:28:57,881 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:28:57,902 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:28:57,958 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:28:57,972 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:28:57,975 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:28:58,000 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:28:58,064 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:28:58,064 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:28:58,064 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:28:58,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:28:58,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:28:58,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:28:58,065 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:28:58,068 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:28:58,139 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 starting 2018-05-02 06:28:58,142 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:28:58,149 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:28:58,155 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:28:58,161 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:28:58,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:28:58,179 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391] 2018-05-02 06:28:58,237 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x3631f08b27900bf 2018-05-02 06:28:58,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:28:58,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:28:58,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751' 2018-05-02 06:28:58,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:28:58,239 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:28:58,240 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:28:58,240 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:28:58,240 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:28:58,240 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751' 2018-05-02 06:28:58,240 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:28:58,241 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:28:58,241 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:28:58,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:28:58,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:28:59,645 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:28:59,646 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:29:01,341 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:29:01,804 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 321 ms, current pipeline: [] 2018-05-02 06:29:01,804 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751.1525242541341 2018-05-02 06:29:01,805 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 06:29:42,637 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:29:42,645 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:29:42,645 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:42,655 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:29:42,668 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:42,669 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:29:42,670 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:42,671 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:29:42,672 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:29:42,873 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:29:43,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:29:43,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 06:29:43,144 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:43,150 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 06:29:43,151 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:43,151 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:43,151 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:43,151 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 06:29:43,153 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:43,153 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:43,187 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:29:43,187 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:29:43,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:43,347 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:29:43,347 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 06:29:43,397 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:43,423 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:43,631 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 06:29:43,636 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:43,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 06:29:43,748 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12854.seqid, newMaxSeqId=12854, maxSeqId=12853 2018-05-02 06:29:43,755 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=12854 2018-05-02 06:29:43,815 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:29:43,850 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:29:43,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:44,590 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:29:44,712 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:29:44,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 91f73e76bbe7bc8a61b1b1299d34c6ab, NAME => 'test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:29:44,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AuthenticationService 2018-05-02 06:29:44,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:44,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=SecureBulkLoadService 2018-05-02 06:29:44,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:44,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:44,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:44,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. service=AccessControlService 2018-05-02 06:29:44,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:44,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:44,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:29:44,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:29:44,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:44,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:29:44,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 06:29:44,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:44,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 06:29:44,738 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:44,738 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:44,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:44,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 06:29:44,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:44,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:44,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:29:44,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:29:44,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:44,743 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:29:44,743 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf 2018-05-02 06:29:44,745 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:44,749 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:44,767 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:29:44,767 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:29:44,769 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:44,770 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:44,798 DEBUG [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/test_cf/62841fd0ef59443db10a779f8a38710c 2018-05-02 06:29:44,799 INFO [StoreOpener-91f73e76bbe7bc8a61b1b1299d34c6ab-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:44,809 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 06:29:44,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab 2018-05-02 06:29:44,810 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:44,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:29:44,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12804.seqid, newMaxSeqId=12804, maxSeqId=12803 2018-05-02 06:29:44,850 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 91f73e76bbe7bc8a61b1b1299d34c6ab; next sequenceid=12804 2018-05-02 06:29:44,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12197.seqid, newMaxSeqId=12197, maxSeqId=12196 2018-05-02 06:29:44,855 INFO [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:29:44,860 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=12197 2018-05-02 06:29:44,860 DEBUG [PostOpenDeployTasks:91f73e76bbe7bc8a61b1b1299d34c6ab] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:29:44,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:44,865 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:29:44,872 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:29:44,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:45,273 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@3029610 2018-05-02 06:29:45,276 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:29:45,277 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:29:45,278 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:29:45,282 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0109, negotiated timeout = 10000 2018-05-02 06:29:45,320 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:29:45,332 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:29:45,836 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:29:45,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:29:45,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 06:29:45,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:45,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 06:29:45,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:45,853 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:45,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:45,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 06:29:45,854 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:45,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:45,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:29:45,855 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:29:45,855 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:45,871 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:29:45,872 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:29:45,874 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:45,876 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:45,914 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 06:29:45,914 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:45,926 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:29:45,959 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:45,959 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:45,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13414.seqid, newMaxSeqId=13414, maxSeqId=13413 2018-05-02 06:29:45,995 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13414 2018-05-02 06:29:45,999 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:29:46,004 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:29:46,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:46,761 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:46,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:29:46,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 06:29:46,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:46,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 06:29:46,914 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:46,915 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:46,915 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:46,915 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 06:29:46,915 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:46,915 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:46,915 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 06:29:46,915 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:46,916 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:46,944 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:29:46,944 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:29:46,946 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:46,951 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:46,954 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:46,963 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 06:29:47,017 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=10 2018-05-02 06:29:47,023 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=11 2018-05-02 06:29:47,026 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:47,029 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:47,030 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:47,796 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 19c6e3a27177cc57e6cf72ac907048ed, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:29:47,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AuthenticationService 2018-05-02 06:29:47,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:47,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=SecureBulkLoadService 2018-05-02 06:29:47,807 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:47,807 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:47,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:47,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AccessControlService 2018-05-02 06:29:47,807 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:47,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:47,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:29:47,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,808 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:47,838 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:29:47,838 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:29:47,840 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:47,840 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:47,887 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/4f8205bfef3349d1b86f968ec0fb4484 2018-05-02 06:29:47,926 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/ac824897155b4c70ba4abc8ffd2779e9 2018-05-02 06:29:47,926 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:47,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:29:47,968 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:29:47,976 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 19c6e3a27177cc57e6cf72ac907048ed; next sequenceid=414 2018-05-02 06:29:47,982 INFO [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,985 DEBUG [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,986 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:48,187 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:29:48,189 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:29:48,192 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:29:48,697 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:29:48,897 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:29:48,898 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:29:48,985 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:29:48,985 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:29:48,985 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:29:48,993 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:29:48,996 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:29:48,996 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:29:49,637 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:49,637 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:29:49,638 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:49,638 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:29:49,638 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:49,638 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:29:50,960 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:50,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 0fc1f394ae11e950c87a982abf7c1035, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:29:50,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AuthenticationService 2018-05-02 06:29:50,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:50,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=SecureBulkLoadService 2018-05-02 06:29:50,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:50,978 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:50,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:50,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AccessControlService 2018-05-02 06:29:50,979 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:50,979 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:50,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:29:50,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:50,980 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:50,994 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:29:50,994 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:29:50,995 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:50,996 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:51,052 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1/bd1273938dfa4fcf838a564a80d2fa5b 2018-05-02 06:29:51,052 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:51,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:29:51,085 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:29:51,092 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 0fc1f394ae11e950c87a982abf7c1035; next sequenceid=411 2018-05-02 06:29:51,098 INFO [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:51,103 DEBUG [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:51,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:51,179 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:51,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:29:51,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:29:51,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:51,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:29:51,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:51,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:51,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:51,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:29:51,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:51,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:51,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:29:51,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:51,194 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,209 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:29:51,209 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:29:51,210 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:51,211 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:51,579 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:29:51,580 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:51,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:29:51,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:29:51,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=411 2018-05-02 06:29:51,628 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:51,632 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:51,633 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:51,960 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:51,960 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:52,401 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:52,436 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:52,437 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:29:52,438 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:29:52,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:52,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:29:52,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:52,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:52,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:52,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:29:52,448 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:52,448 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:52,448 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => a97e624ee736c77fbc6ccefb3abbac31, NAME => 'test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31.', STARTKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A', ENDKEY => '\x0DyC^P\xD7\x944'} 2018-05-02 06:29:52,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AuthenticationService 2018-05-02 06:29:52,449 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:52,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=SecureBulkLoadService 2018-05-02 06:29:52,449 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:52,449 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:52,449 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:52,450 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AccessControlService 2018-05-02 06:29:52,450 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:52,450 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:52,450 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:29:52,450 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:52,451 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,451 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:29:52,451 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:52,452 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,475 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:29:52,476 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:29:52,478 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:52,479 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:52,479 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:29:52,479 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:29:52,480 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:52,481 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:52,557 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/586a58cac1d944569e94cf4983feab67 2018-05-02 06:29:52,588 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:29:52,588 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/8e427e1bd0004b8fa56fee85c7cc2ff5 2018-05-02 06:29:52,588 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:52,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:29:52,639 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:29:52,639 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:52,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:29:52,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:29:52,670 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened a97e624ee736c77fbc6ccefb3abbac31; next sequenceid=420 2018-05-02 06:29:52,675 INFO [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:52,683 DEBUG [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:52,683 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:52,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:29:52,696 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=420 2018-05-02 06:29:52,701 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:52,708 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:52,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:53,420 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:29:53,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:29:53,431 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:53,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:29:53,432 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:53,432 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:53,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:53,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:29:53,432 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:53,433 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:53,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:29:53,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,444 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:29:53,445 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:29:53,446 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:53,452 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:53,483 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:29:53,485 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:29:53,485 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:53,491 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 znode expired, triggering replicatorRemoved event 2018-05-02 06:29:53,491 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:29:53,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:29:53,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/40.seqid, newMaxSeqId=40, maxSeqId=39 2018-05-02 06:29:53,537 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=40 2018-05-02 06:29:53,540 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,544 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:53,639 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,666 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365] zookeeper.ZooKeeper: Session: 0x3631f08b27900c0 closed 2018-05-02 06:29:53,666 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3aa18365-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:29:53,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:29:53,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:29:53,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:53,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:29:53,838 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:53,838 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:53,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:53,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:29:53,838 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:53,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:53,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:29:53,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,839 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:53,850 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:29:53,850 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:29:53,851 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:53,852 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:53,878 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:29:53,879 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:53,889 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:29:53,925 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11477.seqid, newMaxSeqId=11477, maxSeqId=11476 2018-05-02 06:29:53,930 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11477 2018-05-02 06:29:53,934 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,938 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,160 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:29:54,161 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:29:54,161 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,165 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:29:54,166 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,167 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:29:54,167 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,168 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:29:54,168 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:29:54,168 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:29:54,170 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:29:54,170 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,172 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:29:54,176 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,176 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:29:54,178 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:29:54,178 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:29:54,179 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:29:54,183 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=18,queue=0,port=16020] ipc.RpcServer: callId: 1301 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:35088 deadline: 1525242684182, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,184 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 8761 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:60976 deadline: 1525242684184, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,235 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:54,242 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.032 minutes, events=13, succcessCount=5, totalEvents=13, totalSuccessCount=5 2018-05-02 06:29:54,244 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.159 minutes, events=5, succcessCount=5, totalEvents=5, totalSuccessCount=5 2018-05-02 06:29:54,245 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:54,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:29:54,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 06:29:54,246 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 06:29:54,247 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,247 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,247 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,247 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 06:29:54,247 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,247 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,247 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:29:54,248 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:54,255 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:54,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:29:54,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:29:54,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:29:54,257 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,257 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:29:54,257 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:29:54,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:54,259 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,283 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:54,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 670f6b815d2acac905130e5440d59304, NAME => 'test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 06:29:54,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AuthenticationService 2018-05-02 06:29:54,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=SecureBulkLoadService 2018-05-02 06:29:54,292 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,292 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. service=AccessControlService 2018-05-02 06:29:54,294 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 670f6b815d2acac905130e5440d59304 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:54,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,322 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:29:54,322 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:29:54,326 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,328 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,333 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:54,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 5080f353428ccd74e13d5b5493533655, NAME => 'atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:29:54,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 06:29:54,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AuthenticationService 2018-05-02 06:29:54,341 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=SecureBulkLoadService 2018-05-02 06:29:54,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AccessControlService 2018-05-02 06:29:54,344 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,344 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:29:54,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table atlas_janus 5080f353428ccd74e13d5b5493533655 2018-05-02 06:29:54,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:54,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,364 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:29:54,364 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf 2018-05-02 06:29:54,365 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,366 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,367 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:54,368 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:29:54,368 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:29:54,368 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:29:54,369 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,369 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:29:54,369 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:29:54,369 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:54,370 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,403 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:54,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:29:54,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 06:29:54,404 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 06:29:54,404 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,404 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,404 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 06:29:54,405 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,405 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,405 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 06:29:54,405 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:54,405 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:29:54,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:29:54,420 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:29:54,420 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,420 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,420 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:29:54,420 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,420 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,421 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:29:54,421 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:54,421 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,437 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:29:54,437 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:29:54,437 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:29:54,437 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:29:54,442 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,443 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,444 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for e: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,446 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:29:54,446 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:29:54,448 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,452 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,458 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,460 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:29:54,460 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,484 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:29:54,491 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:29:54,491 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:29:54,492 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,493 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,498 DEBUG [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/test_cf/f5f702b4ca0c43be911590949f4eda41 2018-05-02 06:29:54,498 INFO [StoreOpener-670f6b815d2acac905130e5440d59304-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,528 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:29:54,528 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 06:29:54,528 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:29:54,531 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,532 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,536 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/365f190e72194d82bee2f109d2425208 2018-05-02 06:29:54,536 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304 2018-05-02 06:29:54,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:29:54,576 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:29:54,577 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,582 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/38146263a2ae4ae69e1bcaf0e60354e4 2018-05-02 06:29:54,583 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=e, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,604 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:29:54,604 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:29:54,605 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for f: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,606 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,619 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11460.seqid, newMaxSeqId=11460, maxSeqId=11459 2018-05-02 06:29:54,635 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 06:29:54,636 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,640 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11460 2018-05-02 06:29:54,645 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:54,651 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:29:54,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/72.seqid, newMaxSeqId=72, maxSeqId=71 2018-05-02 06:29:54,687 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=72 2018-05-02 06:29:54,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12205.seqid, newMaxSeqId=12205, maxSeqId=12204 2018-05-02 06:29:54,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 06:29:54,694 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:54,697 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 670f6b815d2acac905130e5440d59304; next sequenceid=12205 2018-05-02 06:29:54,701 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f/44685d33ae944737b0ce1882809b4eb3 2018-05-02 06:29:54,704 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:29:54,712 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,712 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,714 INFO [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:54,723 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:29:54,723 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:29:54,724 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for g: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,725 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:29:54,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:29:54,734 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:29:54,735 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,737 DEBUG [PostOpenDeployTasks:670f6b815d2acac905130e5440d59304] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:29:54,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,746 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=408 2018-05-02 06:29:54,747 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12551.seqid, newMaxSeqId=12551, maxSeqId=12550 2018-05-02 06:29:54,754 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:54,761 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:29:54,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,774 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12551 2018-05-02 06:29:54,778 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:54,781 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:54,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:29:54,804 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/987d25463d724745b9b1288d46bcbfd8 2018-05-02 06:29:54,805 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=g, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,818 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=408 2018-05-02 06:29:54,821 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:54,826 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:29:54,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:54,831 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:29:54,831 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:29:54,832 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for h: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,833 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,877 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h/533a2948760c480ba34565e6621f062e 2018-05-02 06:29:54,878 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=h, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,898 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:29:54,898 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:29:54,900 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for i: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,900 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,933 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i/85d84799b3024ff6a31c00aeddf0ee17 2018-05-02 06:29:54,933 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=i, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,953 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:29:54,953 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:29:54,954 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,954 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,958 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,975 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:29:54,975 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:29:54,976 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for m: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,977 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:55,018 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m/86b207dade28462496c6e41eb3fb7b1f 2018-05-02 06:29:55,018 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:55,031 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:29:55,032 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:29:55,032 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for s: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:55,033 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:55,173 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/ab9566a0b14843359aac2c9357d7f66b 2018-05-02 06:29:55,197 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/e6968dada3bb41138eae59b19cb69762 2018-05-02 06:29:55,201 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=s, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:55,208 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:29:55,209 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:29:55,210 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for t: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:55,210 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:55,213 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=t, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:55,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655 2018-05-02 06:29:55,228 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table atlas_janus descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0M)) instead. 2018-05-02 06:29:55,244 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1620.seqid, newMaxSeqId=1620, maxSeqId=1619 2018-05-02 06:29:55,248 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 5080f353428ccd74e13d5b5493533655; next sequenceid=1620 2018-05-02 06:29:55,254 INFO [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Post open deploy tasks for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:55,257 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Finished post open deploy task for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:55,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:55,980 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:29:55,981 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:29:55,983 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:29:56,015 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:56,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:29:56,136 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 06:29:56,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:56,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 06:29:56,137 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:56,137 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:56,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:56,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 06:29:56,137 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:56,137 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:56,137 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:29:56,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:56,138 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:56,158 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:29:56,158 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:29:56,159 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:56,160 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:56,194 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:29:56,211 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 06:29:56,214 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:56,226 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:29:56,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:56,249 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=417 2018-05-02 06:29:56,253 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:56,256 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:56,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:56,491 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:29:56,752 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:29:56,752 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:29:56,845 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:29:56,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:29:56,845 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:29:56,853 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:29:56,856 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:29:56,856 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:29:57,013 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:57,023 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:57,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => 3b0ff50ae790418c1d7b36d704a3c7a8, NAME => 'test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:29:57,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AuthenticationService 2018-05-02 06:29:57,024 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:57,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=SecureBulkLoadService 2018-05-02 06:29:57,024 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:57,025 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:57,025 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:57,025 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AccessControlService 2018-05-02 06:29:57,025 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:57,026 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:57,026 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:29:57,026 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:57,027 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:57,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:29:57,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:29:57,033 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:57,033 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:29:57,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:57,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:57,034 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:57,034 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:29:57,034 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:57,034 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:57,034 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:29:57,035 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:57,035 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:57,046 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:29:57,046 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:29:57,048 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:57,048 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:29:57,048 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:29:57,049 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:57,049 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:57,050 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:57,069 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:29:57,070 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:29:57,080 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:29:57,080 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:57,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:29:57,104 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:57,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened 3b0ff50ae790418c1d7b36d704a3c7a8; next sequenceid=417 2018-05-02 06:29:57,121 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12166.seqid, newMaxSeqId=12166, maxSeqId=12165 2018-05-02 06:29:57,121 INFO [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:57,126 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12166 2018-05-02 06:29:57,127 DEBUG [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:57,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:57,131 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:57,135 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:57,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:57,315 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:57,322 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:29:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 06:29:57,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 06:29:57,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:57,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:57,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:57,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 06:29:57,324 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:57,324 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:57,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:29:57,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:57,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:57,340 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:29:57,340 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:29:57,342 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:57,343 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:57,366 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 06:29:57,366 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:57,372 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:29:57,406 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12898.seqid, newMaxSeqId=12898, maxSeqId=12897 2018-05-02 06:29:57,411 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=12898 2018-05-02 06:29:57,414 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:57,418 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:57,418 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:57,961 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:57,961 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:57,961 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:29:58,798 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655." 2018-05-02 06:29:58,818 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 5080f353428ccd74e13d5b5493533655, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:58,821 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:58,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 5080f353428ccd74e13d5b5493533655, disabling compactions & flushes 2018-05-02 06:29:58,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:58,825 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136." 2018-05-02 06:29:58,825 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1d954f21d711345a9587d995cecea136, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:58,827 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:58,827 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:29:58,827 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:58,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12553.seqid, newMaxSeqId=12553, maxSeqId=12551 2018-05-02 06:29:58,924 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1622.seqid, newMaxSeqId=1622, maxSeqId=1620 2018-05-02 06:29:58,929 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:58,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:58,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:58,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:58,935 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:58,936 WARN [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Not adding moved region record: 5080f353428ccd74e13d5b5493533655 to self. 2018-05-02 06:29:58,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:58,936 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:58,937 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:58,937 WARN [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Not adding moved region record: 1d954f21d711345a9587d995cecea136 to self. 2018-05-02 06:29:58,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:58,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:59,302 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:59,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:29:59,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 06:29:59,312 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:59,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 06:29:59,312 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:59,312 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:59,312 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:59,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 06:29:59,313 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:59,313 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:59,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 06:29:59,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:59,313 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:59,315 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:59,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 5080f353428ccd74e13d5b5493533655, NAME => 'atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:29:59,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AuthenticationService 2018-05-02 06:29:59,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:59,325 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=SecureBulkLoadService 2018-05-02 06:29:59,325 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:59,325 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:59,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:59,325 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AccessControlService 2018-05-02 06:29:59,325 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:59,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:59,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table atlas_janus 5080f353428ccd74e13d5b5493533655 2018-05-02 06:29:59,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:59,326 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:59,331 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:29:59,331 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:29:59,333 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,334 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,351 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:29:59,351 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 06:29:59,352 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for e: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,352 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,369 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 06:29:59,370 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 06:29:59,383 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/38146263a2ae4ae69e1bcaf0e60354e4 2018-05-02 06:29:59,383 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=e, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,389 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:29:59,389 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 06:29:59,391 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for f: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,392 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12554.seqid, newMaxSeqId=12554, maxSeqId=12553 2018-05-02 06:29:59,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12554 2018-05-02 06:29:59,421 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:59,430 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:29:59,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:29:59,435 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f/44685d33ae944737b0ce1882809b4eb3 2018-05-02 06:29:59,435 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,445 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:29:59,445 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 06:29:59,446 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for g: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,447 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,490 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/987d25463d724745b9b1288d46bcbfd8 2018-05-02 06:29:59,491 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=g, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,499 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:29:59,499 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 06:29:59,500 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for h: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,501 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,533 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h/533a2948760c480ba34565e6621f062e 2018-05-02 06:29:59,533 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=h, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,541 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:29:59,541 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 06:29:59,542 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for i: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,542 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,575 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i/85d84799b3024ff6a31c00aeddf0ee17 2018-05-02 06:29:59,575 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=i, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,583 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:29:59,583 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 06:29:59,584 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,585 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,590 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,597 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:29:59,597 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 06:29:59,598 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for m: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,598 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,620 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m/86b207dade28462496c6e41eb3fb7b1f 2018-05-02 06:29:59,620 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,640 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:29:59,640 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 06:29:59,641 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for s: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,642 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,692 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/ab9566a0b14843359aac2c9357d7f66b 2018-05-02 06:29:59,711 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/e6968dada3bb41138eae59b19cb69762 2018-05-02 06:29:59,712 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=s, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,721 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:29:59,722 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 06:29:59,723 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for t: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:59,723 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:59,725 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=t, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:59,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655 2018-05-02 06:29:59,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table atlas_janus descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0M)) instead. 2018-05-02 06:29:59,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1623.seqid, newMaxSeqId=1623, maxSeqId=1622 2018-05-02 06:29:59,758 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 5080f353428ccd74e13d5b5493533655; next sequenceid=1623 2018-05-02 06:29:59,761 INFO [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Post open deploy tasks for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:59,769 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Finished post open deploy task for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:29:59,770 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:00,505 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:30:00,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:30:00,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 06:30:00,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:00,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 06:30:00,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:00,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:00,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:00,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 06:30:00,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:00,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:00,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:30:00,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:30:00,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:00,731 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:30:00,731 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 06:30:00,731 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:00,732 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:00,766 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 06:30:00,766 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:00,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 06:30:00,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12726.seqid, newMaxSeqId=12726, maxSeqId=12725 2018-05-02 06:30:00,812 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12726 2018-05-02 06:30:00,816 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:30:00,820 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:30:00,820 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:00,872 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:30:00,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 3ca34b6bdc72922097d54ce260dbd903, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903.', STARTKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C', ENDKEY => '\xD0\xD7\x945\xE5\x0Dy&'} 2018-05-02 06:30:00,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AuthenticationService 2018-05-02 06:30:00,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:00,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=SecureBulkLoadService 2018-05-02 06:30:00,892 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:00,892 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:00,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:00,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. service=AccessControlService 2018-05-02 06:30:00,892 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:00,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:00,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:30:00,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:30:00,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:00,910 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:30:00,910 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1 2018-05-02 06:30:00,911 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:00,911 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:00,932 DEBUG [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/f1/7914c5e37a8a4498ac542a00c9e38435 2018-05-02 06:30:00,933 INFO [StoreOpener-3ca34b6bdc72922097d54ce260dbd903-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:00,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903 2018-05-02 06:30:00,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:30:00,960 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 3ca34b6bdc72922097d54ce260dbd903; next sequenceid=417 2018-05-02 06:30:00,963 INFO [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:30:00,967 DEBUG [PostOpenDeployTasks:3ca34b6bdc72922097d54ce260dbd903] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:30:00,968 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:01,138 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:01,143 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:01,144 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:01,242 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304." 2018-05-02 06:30:01,243 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 670f6b815d2acac905130e5440d59304, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:30:01,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:01,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 670f6b815d2acac905130e5440d59304, disabling compactions & flushes 2018-05-02 06:30:01,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:30:01,262 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/670f6b815d2acac905130e5440d59304/recovered.edits/12207.seqid, newMaxSeqId=12207, maxSeqId=12205 2018-05-02 06:30:01,267 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:01,267 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:01,267 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:01,268 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:30:01,268 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 670f6b815d2acac905130e5440d59304 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12205 2018-05-02 06:30:01,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,147ae146,1525238855422.670f6b815d2acac905130e5440d59304. 2018-05-02 06:30:01,650 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:01,983 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:01,986 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:30:02,094 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:30:02,094 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:02,094 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:02,103 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:02,105 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:02,105 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:02,175 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,C^P\327\2245\345\004,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96." 2018-05-02 06:30:02,175 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 98abf1ead3bf61c95cc4ffe5e6e5fe96, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:30:02,176 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:02,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 98abf1ead3bf61c95cc4ffe5e6e5fe96, disabling compactions & flushes 2018-05-02 06:30:02,177 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:30:02,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:02,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:02,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:02,214 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,215 WARN [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionServer: Not adding moved region record: 98abf1ead3bf61c95cc4ffe5e6e5fe96 to self. 2018-05-02 06:30:02,218 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,419 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,428 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:30:02,428 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:30:02,428 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:02,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:30:02,429 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:02,429 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:02,429 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:02,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:30:02,429 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:02,429 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:30:02,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:02,443 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:30:02,443 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:30:02,444 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:02,445 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:02,465 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:30:02,466 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:02,472 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:30:02,492 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:30:02,497 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=411 2018-05-02 06:30:02,501 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,503 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:30:02,504 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:03,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 3f187e06c01ee258024c3bcea437345b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:30:03,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AuthenticationService 2018-05-02 06:30:03,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:03,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=SecureBulkLoadService 2018-05-02 06:30:03,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:03,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:03,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:03,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AccessControlService 2018-05-02 06:30:03,385 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:03,385 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:03,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3f187e06c01ee258024c3bcea437345b 2018-05-02 06:30:03,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:03,397 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:30:03,397 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:30:03,398 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:03,399 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:03,421 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1/fa1b12403a784e7a919dcbe2533a2a5f 2018-05-02 06:30:03,422 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:03,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b 2018-05-02 06:30:03,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:30:03,464 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 3f187e06c01ee258024c3bcea437345b; next sequenceid=411 2018-05-02 06:30:03,467 INFO [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,470 DEBUG [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,470 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:04,175 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:30:04,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:30:04,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 06:30:04,189 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:04,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 06:30:04,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:04,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:04,190 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:04,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 06:30:04,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:04,190 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:04,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:30:04,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:30:04,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:04,203 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:30:04,203 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:30:04,204 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:04,204 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:04,252 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:30:04,252 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:04,267 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:30:04,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:30:04,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=417 2018-05-02 06:30:04,313 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:30:04,317 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:30:04,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:05,307 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:30:05,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 960276b77c021b3663429298ac0cccd7, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 06:30:05,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AuthenticationService 2018-05-02 06:30:05,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:05,345 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=SecureBulkLoadService 2018-05-02 06:30:05,345 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:05,345 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:05,345 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:05,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. service=AccessControlService 2018-05-02 06:30:05,346 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:05,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:05,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 960276b77c021b3663429298ac0cccd7 2018-05-02 06:30:05,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:30:05,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:05,348 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:30:05,358 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:30:05,359 DEBUG [StoreOpener-960276b77c021b3663429298ac0cccd7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/f1 2018-05-02 06:30:05,359 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:05,360 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:05,362 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:30:05,363 INFO [StoreOpener-960276b77c021b3663429298ac0cccd7-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:05,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:30:05,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:05,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:30:05,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:05,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:05,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:05,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:30:05,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:05,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:05,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:30:05,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:30:05,364 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:05,368 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7 2018-05-02 06:30:05,374 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:30:05,374 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:30:05,375 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:05,375 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:05,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=7 2018-05-02 06:30:05,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 960276b77c021b3663429298ac0cccd7; next sequenceid=8 2018-05-02 06:30:05,389 INFO [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:30:05,393 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:30:05,393 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:05,397 DEBUG [PostOpenDeployTasks:960276b77c021b3663429298ac0cccd7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:30:05,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:05,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:30:05,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:30:05,417 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=423 2018-05-02 06:30:05,420 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:30:05,423 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:30:05,423 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:06,105 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:30:06,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 06:30:06,115 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 06:30:06,115 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:06,115 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 06:30:06,115 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:06,115 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:06,115 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:06,115 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 06:30:06,116 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:06,116 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:06,116 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:30:06,116 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:30:06,117 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:06,130 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:30:06,130 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 06:30:06,131 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:06,131 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:06,152 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 06:30:06,152 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:06,157 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 06:30:06,173 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12601.seqid, newMaxSeqId=12601, maxSeqId=12600 2018-05-02 06:30:06,176 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12601 2018-05-02 06:30:06,178 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:30:06,181 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:30:06,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:06,267 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:06,269 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:06,272 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:06,481 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b." 2018-05-02 06:30:06,481 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close a8ff96226d546f0ea151823ae73e5a1b, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:30:06,482 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,^P\327\2245\345\rl,1525241408832.41c625158570994727f1c92a8606ca6c." 2018-05-02 06:30:06,482 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Close 41c625158570994727f1c92a8606ca6c, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:30:06,482 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:06,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 06:30:06,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:30:06,482 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:06,483 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 41c625158570994727f1c92a8606ca6c, disabling compactions & flushes 2018-05-02 06:30:06,483 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:30:06,509 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11462.seqid, newMaxSeqId=11462, maxSeqId=11460 2018-05-02 06:30:06,509 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:30:06,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:06,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:06,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:06,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:06,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:06,518 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:06,518 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:30:06,518 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:30:06,518 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegionServer: Adding 41c625158570994727f1c92a8606ca6c move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=408 2018-05-02 06:30:06,518 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegionServer: Adding a8ff96226d546f0ea151823ae73e5a1b move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=11460 2018-05-02 06:30:06,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:30:06,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:30:06,777 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:07,130 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:07,131 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:30:07,222 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:30:07,222 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:07,222 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:07,231 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:07,234 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:07,235 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:08,573 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:30:08,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => e1d84fe7eb9adbf61fec50c75876bce8, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:30:08,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AuthenticationService 2018-05-02 06:30:08,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:08,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=SecureBulkLoadService 2018-05-02 06:30:08,590 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:08,590 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:08,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:08,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AccessControlService 2018-05-02 06:30:08,591 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:08,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:08,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:30:08,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:30:08,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:08,601 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:30:08,601 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:30:08,602 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:08,603 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:08,620 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1/f16708f1c3ad4ecc9898112fc1b25f50 2018-05-02 06:30:08,620 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:08,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:30:08,642 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:30:08,645 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened e1d84fe7eb9adbf61fec50c75876bce8; next sequenceid=414 2018-05-02 06:30:08,648 INFO [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:30:08,651 DEBUG [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:30:08,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:30:11,518 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:11,519 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:11,521 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:12,027 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:12,354 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:12,355 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:30:12,449 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:30:12,449 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:12,450 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:12,456 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:12,459 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:12,459 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:31,070 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:30:54,246 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=122, succcessCount=50, totalEvents=135, totalSuccessCount=55 2018-05-02 06:30:54,249 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=50, succcessCount=50, totalEvents=55, totalSuccessCount=55 2018-05-02 06:31:29,352 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:31,859 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:31,864 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:32,357 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:35,361 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:31:35,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:35,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:31:35,364 DEBUG [RS-EventLoopGroup-1-8] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:35,371 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:31:35,419 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:31:35,420 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:31:35,422 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:31:35,422 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:31:35,422 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:31:54,247 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=48, succcessCount=24, totalEvents=183, totalSuccessCount=79 2018-05-02 06:31:54,255 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=24, succcessCount=24, totalEvents=79, totalSuccessCount=79 2018-05-02 06:32:05,786 DEBUG [RS-EventLoopGroup-1-9] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:08,721 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:08,791 DEBUG [RS-EventLoopGroup-1-10] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:08,793 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 06:32:09,765 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:12,807 DEBUG [RS-EventLoopGroup-1-11] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:12,815 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:32:13,064 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:32:13,065 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:32:13,066 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-11] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:32:40,462 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:32:40,470 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 znode expired, triggering replicatorRemoved event 2018-05-02 06:32:40,470 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:32:46,502 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:46,503 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:32:46,506 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:46,507 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:32:46,508 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:46,511 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:32:46,521 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:46,521 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:32:46,521 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:32:46,521 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:32:46,522 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:46,522 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/10 2018-05-02 06:32:46,523 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:50,578 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:32:50,579 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:32:50,579 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:50,582 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:32:50,584 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:50,584 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:32:50,585 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:50,586 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:50,586 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:32:52,138 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:32:52,140 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:32:52,140 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,141 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:32:52,145 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,145 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:32:52,150 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:32:52,150 DEBUG [RS-EventLoopGroup-1-13] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:52,150 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:32:52,153 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:52,209 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:52,209 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:32:52,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:32:52,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:32:52,211 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,211 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:32:52,212 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:32:52,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:52,213 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,233 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:52,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:32:52,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 06:32:52,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 06:32:52,233 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,234 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,234 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 06:32:52,234 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,234 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:32:52,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:52,235 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,305 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:52,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:32:52,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:32:52,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:32:52,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,306 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:32:52,307 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,307 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:32:52,307 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:52,308 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,338 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:32:52,338 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:32:52,339 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:52,339 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:52,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:32:52,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:32:52,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:52,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:32:52,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:52,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:52,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:52,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:32:52,401 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:52,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:52,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:32:52,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:52,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:52,425 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:32:52,425 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:32:52,426 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:52,426 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:52,512 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:32:52,513 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:32:52,513 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:52,514 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:52,652 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:53,001 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:53,921 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:32:53,921 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:32:53,922 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:53,922 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:53,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 06:32:53,933 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 06:32:53,933 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,933 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,933 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 06:32:53,933 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,933 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:32:53,933 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:53,934 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,935 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:53,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:32:53,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 06:32:53,936 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 06:32:53,936 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,936 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,936 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 06:32:53,936 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,936 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:32:53,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:53,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,948 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:32:53,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 06:32:53,950 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:32:53,951 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:32:53,951 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:53,953 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:53,953 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 06:32:53,953 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:53,953 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:53,953 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:53,953 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 06:32:53,953 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:53,953 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:53,954 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:32:53,954 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:53,954 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:53,957 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:32:53,957 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:32:53,957 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:32:53,957 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:32:53,958 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:53,958 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:53,958 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:53,958 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:53,959 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 06:32:53,959 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:53,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:32:53,962 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:32:53,962 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:53,979 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:32:53,985 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:32:53,993 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:32:53,993 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:32:53,993 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:53,994 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:54,001 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:32:54,001 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,006 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 06:32:54,006 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,007 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:32:54,007 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,012 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:32:54,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:32:54,020 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:32:54,027 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13235.seqid, newMaxSeqId=13235, maxSeqId=13234 2018-05-02 06:32:54,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13235 2018-05-02 06:32:54,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12084.seqid, newMaxSeqId=12084, maxSeqId=12083 2018-05-02 06:32:54,040 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:54,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:54,050 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12084 2018-05-02 06:32:54,053 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=420 2018-05-02 06:32:54,054 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:54,056 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:54,071 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:32:54,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:32:54,079 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 06:32:54,080 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:54,081 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=417 2018-05-02 06:32:54,081 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=417 2018-05-02 06:32:54,081 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13479.seqid, newMaxSeqId=13479, maxSeqId=13478 2018-05-02 06:32:54,084 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:54,084 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:54,089 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:32:54,089 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13479 2018-05-02 06:32:54,091 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:54,106 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:54,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,107 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:54,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,107 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:54,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,108 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:54,108 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:54,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,113 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:54,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,134 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11536.seqid, newMaxSeqId=11536, maxSeqId=11535 2018-05-02 06:32:54,153 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11536 2018-05-02 06:32:54,162 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:54,169 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:54,169 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:54,250 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=51, succcessCount=24, totalEvents=234, totalSuccessCount=103 2018-05-02 06:32:54,262 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=24, succcessCount=24, totalEvents=103, totalSuccessCount=103 2018-05-02 06:32:54,570 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:32:54,573 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:32:54,584 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:32:54,594 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:32:54,595 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/11 2018-05-02 06:32:54,595 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:32:54,653 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 2018-05-02 06:32:54,655 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 znode expired, triggering replicatorRemoved event 2018-05-02 06:32:54,656 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:32:55,222 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:32:55,232 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:32:55,232 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:32:55,232 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:32:55,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:32:55,233 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,233 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:32:55,233 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:32:55,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:32:55,234 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,244 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:32:55,244 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => bc0d9cf47453518915ae21d2cf637c18, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:32:55,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AuthenticationService 2018-05-02 06:32:55,245 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=SecureBulkLoadService 2018-05-02 06:32:55,245 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,245 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,245 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AccessControlService 2018-05-02 06:32:55,245 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,245 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:32:55,246 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:32:55,246 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,259 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:32:55,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:32:55,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 06:32:55,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 06:32:55,260 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,260 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 06:32:55,261 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:32:55,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:32:55,261 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:32:55,261 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:32:55,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,262 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,263 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,284 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:32:55,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:32:55,284 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:32:55,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 06:32:55,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 06:32:55,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:32:55,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:32:55,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:32:55,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => 299c3061e2a10cee5be3bff86a2ec41a, NAME => 'test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:32:55,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:32:55,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AuthenticationService 2018-05-02 06:32:55,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=SecureBulkLoadService 2018-05-02 06:32:55,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,287 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AccessControlService 2018-05-02 06:32:55,289 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,289 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:32:55,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:32:55,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,292 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:32:55,292 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:32:55,293 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,293 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,330 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:32:55,330 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:32:55,331 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,332 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,341 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:32:55,341 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:32:55,342 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:32:55,342 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:32:55,342 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,342 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,342 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,343 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,349 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:32:55,349 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:32:55,350 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,350 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,372 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:32:55,373 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,380 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:32:55,380 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,399 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:32:55,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:32:55,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:32:55,412 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:32:55,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:32:55,413 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:32:55,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,413 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:32:55,413 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,413 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,413 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:32:55,413 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,413 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:32:55,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:32:55,414 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,421 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:32:55,422 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,423 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:32:55,424 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,425 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 06:32:55,425 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,429 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:32:55,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => a6d67b9eb3447b55a82b542d202ddd20, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:32:55,429 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => 93a15c4ca6299bea02a86ac40494d75a, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:32:55,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AuthenticationService 2018-05-02 06:32:55,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=SecureBulkLoadService 2018-05-02 06:32:55,430 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,430 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AccessControlService 2018-05-02 06:32:55,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AuthenticationService 2018-05-02 06:32:55,430 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:32:55,430 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,430 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=SecureBulkLoadService 2018-05-02 06:32:55,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:32:55,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:32:55,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:32:55,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:32:55,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:32:55,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. service=AccessControlService 2018-05-02 06:32:55,431 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:32:55,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:32:55,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:32:55,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,431 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:32:55,431 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:55,440 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/1ea04ea101ef4b97b972fcf1e2c389dc 2018-05-02 06:32:55,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:32:55,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:32:55,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:32:55,459 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:32:55,459 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:32:55,459 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,460 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,470 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/c2e9664311c1425886ec633633fdcd6b 2018-05-02 06:32:55,470 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,470 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:32:55,471 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1 2018-05-02 06:32:55,471 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,472 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,478 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:32:55,478 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:32:55,479 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:32:55,479 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:32:55,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12770.seqid, newMaxSeqId=12770, maxSeqId=12769 2018-05-02 06:32:55,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:32:55,497 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,500 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:32:55,501 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12770 2018-05-02 06:32:55,505 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:32:55,508 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:32:55,514 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened bc0d9cf47453518915ae21d2cf637c18; next sequenceid=414 2018-05-02 06:32:55,514 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:32:55,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,521 INFO [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:32:55,523 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:32:55,532 DEBUG [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:32:55,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13010.seqid, newMaxSeqId=13010, maxSeqId=13009 2018-05-02 06:32:55,536 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:32:55,540 DEBUG [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/f1/5c806a6a8d2b4ef982bb8ac97a2fe60d 2018-05-02 06:32:55,540 INFO [StoreOpener-a6d67b9eb3447b55a82b542d202ddd20-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=13010 2018-05-02 06:32:55,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20 2018-05-02 06:32:55,555 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=420 2018-05-02 06:32:55,555 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:32:55,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11365.seqid, newMaxSeqId=11365, maxSeqId=11364 2018-05-02 06:32:55,559 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:32:55,559 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:32:55,559 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:32:55,562 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:32:55,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:32:55,567 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:32:55,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:32:55,606 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=10 2018-05-02 06:32:55,611 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11365 2018-05-02 06:32:55,611 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened 299c3061e2a10cee5be3bff86a2ec41a; next sequenceid=423 2018-05-02 06:32:55,617 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:32:55,617 INFO [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:32:55,625 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:32:55,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,627 DEBUG [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:32:55,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened 93a15c4ca6299bea02a86ac40494d75a; next sequenceid=11 2018-05-02 06:32:55,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:32:55,639 INFO [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:32:55,646 DEBUG [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:32:55,646 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened a6d67b9eb3447b55a82b542d202ddd20; next sequenceid=414 2018-05-02 06:32:55,653 INFO [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:32:55,662 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:32:55,669 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=423 2018-05-02 06:32:55,672 DEBUG [PostOpenDeployTasks:a6d67b9eb3447b55a82b542d202ddd20] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:32:55,672 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:55,672 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:32:55,693 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:32:55,694 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:32:57,212 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:32:57,214 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:32:57,217 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:32:57,722 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:32:57,985 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:32:57,986 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:32:58,037 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:32:58,038 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:32:58,038 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:32:58,042 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:32:58,044 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:32:58,044 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:33:00,416 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 2018-05-02 06:33:00,419 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 znode expired, triggering replicatorRemoved event 2018-05-02 06:33:00,419 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:33:01,021 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 06:33:01,022 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:33:01,027 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:33:01,067 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751.meta.1525242781028.meta 2018-05-02 06:33:01,067 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:33:01,070 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:01,070 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 06:33:01,070 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,070 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 06:33:01,070 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,070 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,070 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,070 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 06:33:01,071 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,071 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,073 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 06:33:01,076 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 06:33:01,076 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 06:33:01,076 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 06:33:01,076 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 06:33:01,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:33:01,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:33:01,087 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,120 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/05aaed4155904938b4506f41d91511af 2018-05-02 06:33:01,139 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/8169341d68cd4062b78ea05353d96adb 2018-05-02 06:33:01,139 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:33:01,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:33:01,144 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,145 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,159 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/1c4610df23af45aebb0c862393f196e4 2018-05-02 06:33:01,159 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,163 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 06:33:01,170 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 06:33:01,181 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2599.seqid, newMaxSeqId=2599, maxSeqId=2598 2018-05-02 06:33:01,185 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=2599 2018-05-02 06:33:01,200 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 06:33:01,204 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 06:33:01,204 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:01,696 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:01,704 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:01,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:33:01,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 06:33:01,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 06:33:01,705 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,705 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 06:33:01,705 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:33:01,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:01,706 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,728 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:01,736 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:33:01,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:33:01,738 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:33:01,738 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,738 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,738 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:33:01,738 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,738 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:33:01,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:01,739 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:01,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:33:01,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 06:33:01,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 06:33:01,740 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,740 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 06:33:01,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:33:01,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:01,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,745 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:33:01,745 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:33:01,747 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,748 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,760 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:33:01,760 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:33:01,760 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:33:01,760 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:33:01,761 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:01,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:33:01,761 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,761 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,761 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:33:01,761 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,761 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:33:01,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,762 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:33:01,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:33:01,764 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,764 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:01,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,768 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:01,768 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 9f9b6704233f2d2e06a5634fda7f94ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:33:01,768 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => b9be42c9bb7b350e67325f3e6a3a59fb, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:33:01,768 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AuthenticationService 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AuthenticationService 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=SecureBulkLoadService 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=SecureBulkLoadService 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. service=AccessControlService 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AccessControlService 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,769 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,769 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:01,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:33:01,770 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:01,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:33:01,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,787 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 06:33:01,787 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,803 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:33:01,803 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1 2018-05-02 06:33:01,803 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:33:01,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:33:01,803 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:33:01,804 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,804 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,804 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,805 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,805 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 06:33:01,805 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,807 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:33:01,807 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:33:01,808 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,809 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,817 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:33:01,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=31 2018-05-02 06:33:01,842 DEBUG [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/f1/ec664e55bd53459b869c26a0f2088bcc 2018-05-02 06:33:01,843 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:33:01,843 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,843 INFO [StoreOpener-b9be42c9bb7b350e67325f3e6a3a59fb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12768.seqid, newMaxSeqId=12768, maxSeqId=12767 2018-05-02 06:33:01,847 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=32 2018-05-02 06:33:01,852 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:01,859 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:01,860 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:01,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:01,863 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12768 2018-05-02 06:33:01,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:33:01,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb 2018-05-02 06:33:01,882 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1/3d0f7026a4ef4c89aa664ab8b925b29f 2018-05-02 06:33:01,882 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:01,885 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:01,885 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => bae4cdead31e3a4da5b719f67722e3d8, NAME => 'test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8.', STARTKEY => 'f5c28f48', ENDKEY => ''} 2018-05-02 06:33:01,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AuthenticationService 2018-05-02 06:33:01,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=SecureBulkLoadService 2018-05-02 06:33:01,886 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,886 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. service=AccessControlService 2018-05-02 06:33:01,886 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:33:01,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:01,887 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,890 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:01,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => bcf3e62f0ae8e672bee1318720d62930, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:33:01,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AuthenticationService 2018-05-02 06:33:01,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=SecureBulkLoadService 2018-05-02 06:33:01,893 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,893 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,893 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AccessControlService 2018-05-02 06:33:01,894 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:33:01,895 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,895 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:33:01,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:01,895 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,895 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:01,896 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:01,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 32b24a1d0ec05868d69a34a41559e784, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:33:01,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:01,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AuthenticationService 2018-05-02 06:33:01,896 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=SecureBulkLoadService 2018-05-02 06:33:01,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,897 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. service=AccessControlService 2018-05-02 06:33:01,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,897 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:33:01,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:01,898 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,899 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:01,901 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12816.seqid, newMaxSeqId=12816, maxSeqId=12815 2018-05-02 06:33:01,911 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:01,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:33:01,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 89df5caac424c7424fede4183c6dce19, NAME => 'test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:33:01,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:33:01,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AuthenticationService 2018-05-02 06:33:01,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=SecureBulkLoadService 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:33:01,912 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,912 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,912 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,912 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,912 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,912 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:33:01,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 06:33:01,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 06:33:01,913 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,913 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AccessControlService 2018-05-02 06:33:01,913 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:01,914 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,914 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:33:01,914 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:01,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12816 2018-05-02 06:33:01,914 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,915 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:33:01,915 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf 2018-05-02 06:33:01,915 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 89df5caac424c7424fede4183c6dce19 2018-05-02 06:33:01,915 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:01,916 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:33:01,916 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1 2018-05-02 06:33:01,916 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,916 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,916 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,916 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:33:01,916 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:33:01,917 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,917 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,918 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,918 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,924 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:01,930 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened b9be42c9bb7b350e67325f3e6a3a59fb; next sequenceid=417 2018-05-02 06:33:01,931 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:33:01,931 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:33:01,931 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,931 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:33:01,931 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,931 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,931 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,931 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:33:01,932 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:33:01,932 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:01,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,934 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:01,934 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:01,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:33:01,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:33:01,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:33:01,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:33:01,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:33:01,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:33:01,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,935 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:01,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,935 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:01,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:33:01,935 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:33:01,936 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,936 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,937 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 06:33:01,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 25414d6e395eadb383c40973693beb12, NAME => 'test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:33:01,937 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,937 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AuthenticationService 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => a28a981dbde91491f904c000efc74ecb, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=SecureBulkLoadService 2018-05-02 06:33:01,937 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,937 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=AuthenticationService 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,937 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:01,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => e56a9c7383092895c06ee33b9b84d892, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:33:01,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AuthenticationService 2018-05-02 06:33:01,938 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=SecureBulkLoadService 2018-05-02 06:33:01,938 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,938 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,938 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. service=AccessControlService 2018-05-02 06:33:01,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a28a981dbde91491f904c000efc74ecb 2018-05-02 06:33:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:01,937 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AccessControlService 2018-05-02 06:33:01,939 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,939 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 25414d6e395eadb383c40973693beb12 2018-05-02 06:33:01,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:01,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:01,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 06:33:01,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,938 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:01,938 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=SecureBulkLoadService 2018-05-02 06:33:01,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:33:01,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:01,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,941 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:01,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AccessControlService 2018-05-02 06:33:01,942 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,942 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 5bd8c2cd29520d0d27cacb48e7436a6d, NAME => 'test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => a58d4c86d2df306cc460a231fd5a1ac1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:33:01,942 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AuthenticationService 2018-05-02 06:33:01,942 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=SecureBulkLoadService 2018-05-02 06:33:01,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AuthenticationService 2018-05-02 06:33:01,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:01,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=SecureBulkLoadService 2018-05-02 06:33:01,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:01,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AccessControlService 2018-05-02 06:33:01,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:01,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,943 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:33:01,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:01,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,943 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:01,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. service=AccessControlService 2018-05-02 06:33:01,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:33:01,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:01,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,953 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:33:01,953 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:33:01,954 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,955 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:33:01,955 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,955 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:33:01,955 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,956 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,957 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:33:01,957 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf 2018-05-02 06:33:01,957 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:01,958 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:01,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:33:01,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:01,964 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 06:33:01,964 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:01,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:01,965 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 06:33:01,965 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:01,965 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:01,976 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:01,982 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:01,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:01,989 INFO [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:01,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:01,993 DEBUG [PostOpenDeployTasks:b9be42c9bb7b350e67325f3e6a3a59fb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:01,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:01,998 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:33:01,998 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:33:01,999 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,000 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,002 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=423 2018-05-02 06:33:02,002 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 9f9b6704233f2d2e06a5634fda7f94ca; next sequenceid=417 2018-05-02 06:33:02,002 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:33:02,003 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:33:02,003 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:33:02,003 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:33:02,003 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,004 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,004 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,004 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,008 INFO [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:02,008 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:02,010 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:02,014 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1/a3522ed3bfda433db7a713973ceaf88b 2018-05-02 06:33:02,017 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,018 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:02,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,018 DEBUG [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:02,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,024 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:33:02,024 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:33:02,025 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,026 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,036 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:33:02,036 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:33:02,037 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,038 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,039 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:33:02,039 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:33:02,039 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,040 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:33:02,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:33:02,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:33:02,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:33:02,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:33:02,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:02,048 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,049 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:02,053 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:33:02,054 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1 2018-05-02 06:33:02,054 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1 2018-05-02 06:33:02,055 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,056 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,057 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:33:02,057 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:33:02,058 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:33:02,057 DEBUG [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/f1/25e6dd3bb4da4a4da1bd529eeab4af61 2018-05-02 06:33:02,058 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:33:02,058 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,058 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,059 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,059 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,064 DEBUG [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/test_cf/bc281d1814c14ba9aae3e3f6022e60f7 2018-05-02 06:33:02,077 INFO [StoreOpener-32b24a1d0ec05868d69a34a41559e784-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,077 INFO [StoreOpener-bae4cdead31e3a4da5b719f67722e3d8-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,090 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:33:02,093 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:33:02,093 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,102 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8 2018-05-02 06:33:02,104 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:02,104 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 47377dfacc235cc247254a0eb8fe4f44, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => a3403d29839e289caca7a1e3c5cd71be, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AuthenticationService 2018-05-02 06:33:02,105 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=SecureBulkLoadService 2018-05-02 06:33:02,104 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:02,105 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,105 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AuthenticationService 2018-05-02 06:33:02,105 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,105 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:02,105 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=SecureBulkLoadService 2018-05-02 06:33:02,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AccessControlService 2018-05-02 06:33:02,105 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:02,105 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,105 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,106 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:02,106 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,106 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,106 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:33:02,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 298977e880ecf479f4c50be95a5e8eb5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:33:02,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AccessControlService 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AuthenticationService 2018-05-02 06:33:02,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:33:02,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=SecureBulkLoadService 2018-05-02 06:33:02,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:33:02,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:02,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. service=AccessControlService 2018-05-02 06:33:02,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:02,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:33:02,109 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,109 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:33:02,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:02,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:33:02,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:02,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,112 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784 2018-05-02 06:33:02,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:33:02,123 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 06:33:02,123 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,132 DEBUG [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/test_cf/e3402645d07644fb92ee0b1234e4c0d4 2018-05-02 06:33:02,132 INFO [StoreOpener-5bd8c2cd29520d0d27cacb48e7436a6d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,134 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:33:02,134 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:33:02,134 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,135 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,136 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:33:02,136 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,146 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba 2018-05-02 06:33:02,146 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,152 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:33:02,152 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,154 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:33:02,154 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,161 DEBUG [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/f1/a0d64d2aee044a9a8aa5149ccef781a3 2018-05-02 06:33:02,161 INFO [StoreOpener-a28a981dbde91491f904c000efc74ecb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,166 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:33:02,176 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:02,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19 2018-05-02 06:33:02,176 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:02,177 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:02,180 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:33:02,180 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:33:02,181 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,182 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,182 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:33:02,183 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1 2018-05-02 06:33:02,183 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:33:02,183 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:33:02,183 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:33:02,184 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,184 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/bc3bcfcc061c4f8983a05c3b21b4aba4 2018-05-02 06:33:02,185 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,185 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:33:02,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d 2018-05-02 06:33:02,187 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,189 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,192 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:33:02,192 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,193 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:33:02,197 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:33:02,203 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:33:02,214 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:33:02,214 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,220 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1/cb0610e65b5444349a49772cf9289fa4 2018-05-02 06:33:02,221 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb 2018-05-02 06:33:02,225 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:02,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:33:02,241 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:33:02,252 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened bcf3e62f0ae8e672bee1318720d62930; next sequenceid=414 2018-05-02 06:33:02,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 32b24a1d0ec05868d69a34a41559e784; next sequenceid=411 2018-05-02 06:33:02,268 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:33:02,269 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12359.seqid, newMaxSeqId=12359, maxSeqId=12358 2018-05-02 06:33:02,270 INFO [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:02,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 06:33:02,273 INFO [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:02,275 DEBUG [PostOpenDeployTasks:32b24a1d0ec05868d69a34a41559e784] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:02,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:33:02,275 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1/abb993ca728f419faab17bf60d381de0 2018-05-02 06:33:02,276 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:33:02,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:33:02,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:33:02,277 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:33:02,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:02,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,280 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/d841feb0096c401b9a78e0050ee83d68 2018-05-02 06:33:02,280 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,281 DEBUG [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:02,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:33:02,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 06:33:02,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 06:33:02,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened bae4cdead31e3a4da5b719f67722e3d8; next sequenceid=12359 2018-05-02 06:33:02,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 06:33:02,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 06:33:02,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:02,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,286 INFO [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:02,289 DEBUG [PostOpenDeployTasks:bae4cdead31e3a4da5b719f67722e3d8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:02,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 54c783f1faee76bcce84aee6145e82d1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:33:02,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AuthenticationService 2018-05-02 06:33:02,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=SecureBulkLoadService 2018-05-02 06:33:02,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. service=AccessControlService 2018-05-02 06:33:02,292 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:33:02,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:02,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,298 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:33:02,298 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,299 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:33:02,300 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13656.seqid, newMaxSeqId=13656, maxSeqId=13655 2018-05-02 06:33:02,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12 2018-05-02 06:33:02,307 DEBUG [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/f1/5dd531f9eb2a49a68712ee9638f0247b 2018-05-02 06:33:02,308 INFO [StoreOpener-298977e880ecf479f4c50be95a5e8eb5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,324 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13656 2018-05-02 06:33:02,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,327 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11999.seqid, newMaxSeqId=11999, maxSeqId=11998 2018-05-02 06:33:02,328 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,330 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12887.seqid, newMaxSeqId=12887, maxSeqId=12886 2018-05-02 06:33:02,330 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:33:02,331 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:33:02,333 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,334 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:02,339 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5 2018-05-02 06:33:02,340 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:02,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 7524beb6ac348dac037dbf298ba07495, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:33:02,341 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:33:02,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AuthenticationService 2018-05-02 06:33:02,342 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=SecureBulkLoadService 2018-05-02 06:33:02,342 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,342 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,342 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AccessControlService 2018-05-02 06:33:02,343 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,343 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 7524beb6ac348dac037dbf298ba07495 2018-05-02 06:33:02,344 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:02,344 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,346 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:33:02,346 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:33:02,347 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,347 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11999 2018-05-02 06:33:02,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 89df5caac424c7424fede4183c6dce19; next sequenceid=423 2018-05-02 06:33:02,349 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened a58d4c86d2df306cc460a231fd5a1ac1; next sequenceid=417 2018-05-02 06:33:02,349 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:33:02,349 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1 2018-05-02 06:33:02,349 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12440.seqid, newMaxSeqId=12440, maxSeqId=12439 2018-05-02 06:33:02,350 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,350 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,351 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:33:02,351 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:33:02,351 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,352 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,354 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=423 2018-05-02 06:33:02,354 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 5bd8c2cd29520d0d27cacb48e7436a6d; next sequenceid=12887 2018-05-02 06:33:02,356 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened a28a981dbde91491f904c000efc74ecb; next sequenceid=417 2018-05-02 06:33:02,357 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12440 2018-05-02 06:33:02,374 INFO [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:02,375 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:02,375 INFO [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:02,386 INFO [PostOpenDeployTasks:a28a981dbde91491f904c000efc74ecb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:02,386 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:02,386 INFO [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:02,387 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:02,389 DEBUG [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:02,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,392 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:02,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,399 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => a47cc34ca47759b3fd7bcaa79faebd3d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:33:02,399 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AuthenticationService 2018-05-02 06:33:02,399 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:33:02,399 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=SecureBulkLoadService 2018-05-02 06:33:02,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:33:02,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:33:02,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:33:02,400 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:02,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AccessControlService 2018-05-02 06:33:02,400 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:33:02,400 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:33:02,401 DEBUG [PostOpenDeployTasks:a28a981dbde91491f904c000efc74ecb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:02,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,400 DEBUG [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:02,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:33:02,402 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:02,403 DEBUG [PostOpenDeployTasks:5bd8c2cd29520d0d27cacb48e7436a6d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:02,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,404 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:02,404 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:02,404 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12546.seqid, newMaxSeqId=12546, maxSeqId=12545 2018-05-02 06:33:02,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,418 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 47377dfacc235cc247254a0eb8fe4f44; next sequenceid=417 2018-05-02 06:33:02,419 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:33:02,419 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:33:02,427 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,427 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,434 INFO [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:02,441 DEBUG [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:02,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,453 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 25414d6e395eadb383c40973693beb12; next sequenceid=423 2018-05-02 06:33:02,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12546 2018-05-02 06:33:02,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened e56a9c7383092895c06ee33b9b84d892; next sequenceid=414 2018-05-02 06:33:02,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=420 2018-05-02 06:33:02,454 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:33:02,455 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:33:02,455 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12807.seqid, newMaxSeqId=12807, maxSeqId=12806 2018-05-02 06:33:02,455 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,456 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,457 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,471 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:33:02,471 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12807 2018-05-02 06:33:02,472 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 298977e880ecf479f4c50be95a5e8eb5; next sequenceid=417 2018-05-02 06:33:02,472 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:02,472 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:33:02,472 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:33:02,473 INFO [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:02,473 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=3, currentSize=157.63 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=157.63 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:02,474 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:33:02,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:33:02,478 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:02,478 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,480 DEBUG [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:02,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,485 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:33:02,488 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:02,490 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/821797aa04f34c5ba99842ed2104658a 2018-05-02 06:33:02,491 INFO [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:02,492 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:02,492 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,494 DEBUG [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:02,494 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,499 INFO [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:02,506 DEBUG [PostOpenDeployTasks:298977e880ecf479f4c50be95a5e8eb5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:02,508 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,516 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:02,522 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:33:02,522 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,534 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:02,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:33:02,556 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 06:33:02,557 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,566 DEBUG [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/f1/accb28f8bfa44c80a458ea61bfad3c0c 2018-05-02 06:33:02,566 INFO [StoreOpener-54c783f1faee76bcce84aee6145e82d1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,576 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1/1d1b806509a34e0c9777f7096fbc3f1c 2018-05-02 06:33:02,576 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,577 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:33:02,577 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:33:02,580 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:33:02,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 06:33:02,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1 2018-05-02 06:33:02,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=420 2018-05-02 06:33:02,613 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:02,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:33:02,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495 2018-05-02 06:33:02,619 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,623 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:02,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,635 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened a3403d29839e289caca7a1e3c5cd71be; next sequenceid=423 2018-05-02 06:33:02,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:02,651 INFO [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:02,658 DEBUG [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:02,658 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,663 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=414 2018-05-02 06:33:02,670 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:02,673 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:02,674 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:33:02,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:33:02,696 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=423 2018-05-02 06:33:02,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:33:02,700 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:33:02,708 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 54c783f1faee76bcce84aee6145e82d1; next sequenceid=417 2018-05-02 06:33:02,710 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:02,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 7524beb6ac348dac037dbf298ba07495; next sequenceid=414 2018-05-02 06:33:02,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened a47cc34ca47759b3fd7bcaa79faebd3d; next sequenceid=411 2018-05-02 06:33:02,716 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:02,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,719 INFO [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:02,725 DEBUG [PostOpenDeployTasks:54c783f1faee76bcce84aee6145e82d1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:02,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,735 INFO [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:02,736 INFO [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:02,740 DEBUG [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:02,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:02,747 DEBUG [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:02,748 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:04,068 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:04,068 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:33:06,076 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:33:06,078 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:33:06,081 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:33:06,586 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:33:06,808 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:33:06,809 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:33:06,891 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:33:06,891 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:33:06,891 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:33:06,898 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:33:06,901 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:33:06,901 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:33:09,637 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:33:09,637 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers Wed May 2 06:33:10 UTC 2018 Terminating regionserver 2018-05-02 06:33:10,209 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:33:10,209 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:33:10,209 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:33:10,209 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:33:10,209 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:33:10,209 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:33:10,209 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:33:10,209 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:10,209 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:10,210 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:33:10,210 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=15.948 seconds, events=20, succcessCount=20, totalEvents=123, totalSuccessCount=123 2018-05-02 06:33:10,211 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:33:10,211 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 06:33:10,211 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:33:10,211 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=15.961 seconds, events=40, succcessCount=20, totalEvents=274, totalSuccessCount=123 2018-05-02 06:33:10,211 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:33:10,211 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:33:10,211 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:33:10,212 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:33:10,212 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:33:10,212 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751' ***** 2018-05-02 06:33:10,213 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,213 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,213 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:33:10,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:33:10,214 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:33:10,214 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 exiting 2018-05-02 06:33:10,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:33:10,231 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:33:10,238 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@60fef5e7{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:33:10,238 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:33:10,238 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:33:10,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:33:10,242 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:33:10,242 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:33:10,243 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:33:10,243 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:33:10,243 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,244 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:33:10,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:10,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 299c3061e2a10cee5be3bff86a2ec41a, disabling compactions & flushes 2018-05-02 06:33:10,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:10,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,245 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,246 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,246 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:33:10,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:10,247 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,247 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,247 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,248 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,248 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,250 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,251 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,251 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,251 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,252 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,252 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,253 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,253 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,254 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,257 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,257 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,258 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,258 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,262 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,263 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,263 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,264 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,264 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12818.seqid, newMaxSeqId=12818, maxSeqId=12816 2018-05-02 06:33:10,264 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,266 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,266 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,266 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,268 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:10,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,269 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:10,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,271 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,271 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:10,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,276 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,276 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:33:10,277 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:33:10,278 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,278 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a28a981dbde91491f904c000efc74ecb, disabling compactions & flushes 2018-05-02 06:33:10,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:10,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:33:10,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:10,279 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:33:10,279 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,279 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,279 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,279 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:33:10,279 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:10,279 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,282 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,283 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,283 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,283 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,284 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,284 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,284 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:10,285 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:33:10,285 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x3aa18365 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:33:10,286 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:33:10,287 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:33:10,287 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:33:10,287 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:33:10,287 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,289 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Waiting on 73 regions to close 2018-05-02 06:33:10,290 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,290 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:33:10,292 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:33:10,298 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a28a981dbde91491f904c000efc74ecb/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,299 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=85.76 KB memstore heap size=125.40 KB 2018-05-02 06:33:10,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,311 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,311 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:10,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525241408832.a28a981dbde91491f904c000efc74ecb. 2018-05-02 06:33:10,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,312 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a58d4c86d2df306cc460a231fd5a1ac1, disabling compactions & flushes 2018-05-02 06:33:10,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:10,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12556.seqid, newMaxSeqId=12556, maxSeqId=12554 2018-05-02 06:33:10,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,322 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:10,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:33:10,323 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,325 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:33:10,325 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:10,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,326 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:10,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:33:10,326 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,327 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 3f187e06c01ee258024c3bcea437345b, disabling compactions & flushes 2018-05-02 06:33:10,327 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:10,342 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,348 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13658.seqid, newMaxSeqId=13658, maxSeqId=13656 2018-05-02 06:33:10,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,350 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,350 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:10,355 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:33:10,356 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,356 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:33:10,357 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:10,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,358 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:10,359 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:33:10,359 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,359 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 5080f353428ccd74e13d5b5493533655, disabling compactions & flushes 2018-05-02 06:33:10,360 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:10,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,372 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:10,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:33:10,372 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing e56a9c7383092895c06ee33b9b84d892, disabling compactions & flushes 2018-05-02 06:33:10,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:10,382 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,384 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1625.seqid, newMaxSeqId=1625, maxSeqId=1623 2018-05-02 06:33:10,385 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,385 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,386 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:10,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:33:10,387 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 25414d6e395eadb383c40973693beb12, disabling compactions & flushes 2018-05-02 06:33:10,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:10,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,388 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:10,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 06:33:10,389 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3ca34b6bdc72922097d54ce260dbd903, disabling compactions & flushes 2018-05-02 06:33:10,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:10,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,404 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:10,404 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:33:10,404 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,405 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 89df5caac424c7424fede4183c6dce19, disabling compactions & flushes 2018-05-02 06:33:10,405 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:10,409 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3ca34b6bdc72922097d54ce260dbd903/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,412 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:10,413 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C,1525241408832.3ca34b6bdc72922097d54ce260dbd903. 2018-05-02 06:33:10,413 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,414 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 06:33:10,414 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:10,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,415 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:10,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:33:10,416 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 06:33:10,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:10,429 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,433 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,433 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,433 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,433 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:10,433 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:33:10,434 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 960276b77c021b3663429298ac0cccd7, disabling compactions & flushes 2018-05-02 06:33:10,434 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:10,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12856.seqid, newMaxSeqId=12856, maxSeqId=12854 2018-05-02 06:33:10,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/34.seqid, newMaxSeqId=34, maxSeqId=32 2018-05-02 06:33:10,442 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,442 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,442 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,443 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:10,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 06:33:10,444 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,445 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:33:10,445 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:33:10,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:10,457 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/960276b77c021b3663429298ac0cccd7/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=8 2018-05-02 06:33:10,460 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,460 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,460 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,460 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:10,461 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525241408832.960276b77c021b3663429298ac0cccd7. 2018-05-02 06:33:10,461 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,461 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 19c6e3a27177cc57e6cf72ac907048ed, disabling compactions & flushes 2018-05-02 06:33:10,461 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:10,480 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,481 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12001.seqid, newMaxSeqId=12001, maxSeqId=11999 2018-05-02 06:33:10,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,484 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:10,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:33:10,484 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing a6d67b9eb3447b55a82b542d202ddd20, disabling compactions & flushes 2018-05-02 06:33:10,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:10,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,486 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:10,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:33:10,486 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 681566c13ee68fa7a27c4bd39d5a79e0, disabling compactions & flushes 2018-05-02 06:33:10,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:10,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,494 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,494 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,494 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,494 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:10,494 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:33:10,495 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,495 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a3403d29839e289caca7a1e3c5cd71be, disabling compactions & flushes 2018-05-02 06:33:10,495 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:10,517 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,519 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=85.76 KB at sequenceid=2735 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/d94dbfd81b8f43fe9bc92ec544ae2409 2018-05-02 06:33:10,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a6d67b9eb3447b55a82b542d202ddd20/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,521 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:10,521 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:33:10,522 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 7524beb6ac348dac037dbf298ba07495, disabling compactions & flushes 2018-05-02 06:33:10,522 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x0DyC^P\xD7\x944,1525241408832.a6d67b9eb3447b55a82b542d202ddd20. 2018-05-02 06:33:10,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 93a15c4ca6299bea02a86ac40494d75a, disabling compactions & flushes 2018-05-02 06:33:10,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:10,525 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,525 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,525 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,525 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:10,525 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:33:10,526 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:33:10,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:10,539 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=11 2018-05-02 06:33:10,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12442.seqid, newMaxSeqId=12442, maxSeqId=12440 2018-05-02 06:33:10,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,542 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:10,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:33:10,543 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,543 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:10,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:33:10,543 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,544 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:33:10,544 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:10,544 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing d5e9f3919d5e95ad2d6e01e1e16fa8ad, disabling compactions & flushes 2018-05-02 06:33:10,544 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,545 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:33:10,545 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing bae4cdead31e3a4da5b719f67722e3d8, disabling compactions & flushes 2018-05-02 06:33:10,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:10,560 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/d94dbfd81b8f43fe9bc92ec544ae2409 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409 2018-05-02 06:33:10,587 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bae4cdead31e3a4da5b719f67722e3d8/recovered.edits/12361.seqid, newMaxSeqId=12361, maxSeqId=12359 2018-05-02 06:33:10,588 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,589 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13481.seqid, newMaxSeqId=13481, maxSeqId=13479 2018-05-02 06:33:10,589 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,589 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:10,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,f5c28f48,1525238855422.bae4cdead31e3a4da5b719f67722e3d8. 2018-05-02 06:33:10,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 98abf1ead3bf61c95cc4ffe5e6e5fe96, disabling compactions & flushes 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,591 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:33:10,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:10,592 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,592 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:10,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:33:10,593 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,593 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:33:10,593 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:10,595 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d94dbfd81b8f43fe9bc92ec544ae2409, entries=536, sequenceid=2735, filesize=93.6 K 2018-05-02 06:33:10,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12086.seqid, newMaxSeqId=12086, maxSeqId=12084 2018-05-02 06:33:10,609 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13237.seqid, newMaxSeqId=13237, maxSeqId=13235 2018-05-02 06:33:10,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:10,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:33:10,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:33:10,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:10,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 51969dda9dfa8895c283f334f944e248, disabling compactions & flushes 2018-05-02 06:33:10,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:10,625 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,626 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Finished memstore flush; data size ~85.76 KB/87814, heap size ~125.61 KB/128624, currentsize=0 B/0 for 1588230740 in 327ms, sequenceid=2735, compaction requested=true 2018-05-02 06:33:10,627 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,628 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,628 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,628 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:10,628 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:33:10,628 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:33:10,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:10,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,637 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,637 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,637 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,637 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:10,637 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:33:10,637 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,638 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 06:33:10,638 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:10,640 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12548.seqid, newMaxSeqId=12548, maxSeqId=12546 2018-05-02 06:33:10,644 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,645 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:10,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:33:10,646 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:33:10,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:10,666 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13012.seqid, newMaxSeqId=13012, maxSeqId=13010 2018-05-02 06:33:10,668 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11367.seqid, newMaxSeqId=11367, maxSeqId=11365 2018-05-02 06:33:10,668 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2738.seqid, newMaxSeqId=2738, maxSeqId=2599 2018-05-02 06:33:10,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,670 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:10,670 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:33:10,671 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing bcf3e62f0ae8e672bee1318720d62930, disabling compactions & flushes 2018-05-02 06:33:10,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:10,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,672 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,672 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 0fc1f394ae11e950c87a982abf7c1035, disabling compactions & flushes 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:10,672 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 06:33:10,672 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 06:33:10,677 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12772.seqid, newMaxSeqId=12772, maxSeqId=12770 2018-05-02 06:33:10,680 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,680 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,680 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,681 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:10,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:33:10,681 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 298977e880ecf479f4c50be95a5e8eb5, disabling compactions & flushes 2018-05-02 06:33:10,682 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:10,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,689 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,690 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,690 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,690 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:10,690 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:33:10,691 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,691 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 06:33:10,691 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:10,691 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,691 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,691 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,691 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:10,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:33:10,692 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 91f73e76bbe7bc8a61b1b1299d34c6ab, disabling compactions & flushes 2018-05-02 06:33:10,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:10,696 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/298977e880ecf479f4c50be95a5e8eb5/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,699 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,699 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,699 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,699 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:10,699 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,e\x0DyC^P\xD7\x86,1525241408832.298977e880ecf479f4c50be95a5e8eb5. 2018-05-02 06:33:10,699 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:33:10,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:10,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12603.seqid, newMaxSeqId=12603, maxSeqId=12601 2018-05-02 06:33:10,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/91f73e76bbe7bc8a61b1b1299d34c6ab/recovered.edits/12806.seqid, newMaxSeqId=12806, maxSeqId=12804 2018-05-02 06:33:10,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,709 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:10,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 06:33:10,710 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 93aea36f9251cfe49e28f84a517e3630, disabling compactions & flushes 2018-05-02 06:33:10,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:10,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,711 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:10,711 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,f5c28f48,1525237868269.91f73e76bbe7bc8a61b1b1299d34c6ab. 2018-05-02 06:33:10,711 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 47c574242e461d8e7a12972718bc27ff, disabling compactions & flushes 2018-05-02 06:33:10,712 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:10,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,718 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:10,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:33:10,719 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 06:33:10,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:10,725 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,726 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,728 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:10,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:33:10,728 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing a97e624ee736c77fbc6ccefb3abbac31, disabling compactions & flushes 2018-05-02 06:33:10,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:10,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,730 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:10,730 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:33:10,731 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 47377dfacc235cc247254a0eb8fe4f44, disabling compactions & flushes 2018-05-02 06:33:10,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:10,736 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12199.seqid, newMaxSeqId=12199, maxSeqId=12197 2018-05-02 06:33:10,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,739 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:10,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:33:10,739 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,740 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 06:33:10,740 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:10,745 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,747 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,748 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:10,748 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:33:10,749 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing bc0d9cf47453518915ae21d2cf637c18, disabling compactions & flushes 2018-05-02 06:33:10,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:33:10,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:33:10,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:10,755 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12900.seqid, newMaxSeqId=12900, maxSeqId=12898 2018-05-02 06:33:10,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,758 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:10,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:33:10,758 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:33:10,759 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:10,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,764 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,766 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:10,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:33:10,766 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing fa24e8d8fdd999d38faae5dbf847c334, disabling compactions & flushes 2018-05-02 06:33:10,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:10,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,768 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,768 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:10,768 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:33:10,768 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,768 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 9f9b6704233f2d2e06a5634fda7f94ca, disabling compactions & flushes 2018-05-02 06:33:10,768 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:10,773 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11538.seqid, newMaxSeqId=11538, maxSeqId=11536 2018-05-02 06:33:10,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,776 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:10,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:33:10,776 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 06:33:10,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:10,780 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,784 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:10,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:33:10,784 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,785 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:10,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:33:10,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:33:10,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:10,792 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/74.seqid, newMaxSeqId=74, maxSeqId=72 2018-05-02 06:33:10,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,795 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:10,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:33:10,796 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,796 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 06:33:10,796 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:10,799 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12809.seqid, newMaxSeqId=12809, maxSeqId=12807 2018-05-02 06:33:10,801 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,802 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:10,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:33:10,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 06:33:10,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:10,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,803 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,804 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:10,804 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:33:10,804 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,805 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 32b24a1d0ec05868d69a34a41559e784, disabling compactions & flushes 2018-05-02 06:33:10,805 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:10,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12728.seqid, newMaxSeqId=12728, maxSeqId=12726 2018-05-02 06:33:10,811 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,811 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,811 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,811 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:10,812 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 06:33:10,812 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,813 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 685781049fdcc89efe3561b69e4d3810, disabling compactions & flushes 2018-05-02 06:33:10,813 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:10,817 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12770.seqid, newMaxSeqId=12770, maxSeqId=12768 2018-05-02 06:33:10,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/32b24a1d0ec05868d69a34a41559e784/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,819 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:10,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:33:10,820 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:33:10,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:10,820 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,821 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:10,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,yC^P\xD7\x945\xD4,1525241408832.32b24a1d0ec05868d69a34a41559e784. 2018-05-02 06:33:10,821 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing b9be42c9bb7b350e67325f3e6a3a59fb, disabling compactions & flushes 2018-05-02 06:33:10,822 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:10,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:33:10,831 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,831 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,831 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,831 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:10,832 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:33:10,832 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,833 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:33:10,833 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:10,838 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/42.seqid, newMaxSeqId=42, maxSeqId=40 2018-05-02 06:33:10,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b9be42c9bb7b350e67325f3e6a3a59fb/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,841 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:10,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:33:10,841 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 7d91c8087e31e21951799651a5262353, disabling compactions & flushes 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,842 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:10,842 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF2\x86\xBC\xA1\xAF(k\xA8,1525241408832.b9be42c9bb7b350e67325f3e6a3a59fb. 2018-05-02 06:33:10,843 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing e1d84fe7eb9adbf61fec50c75876bce8, disabling compactions & flushes 2018-05-02 06:33:10,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:10,855 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11479.seqid, newMaxSeqId=11479, maxSeqId=11477 2018-05-02 06:33:10,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,858 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:10,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:33:10,858 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing a47cc34ca47759b3fd7bcaa79faebd3d, disabling compactions & flushes 2018-05-02 06:33:10,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:10,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] ipc.RpcServer: callId: 1352 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:35088 deadline: 1525242880862, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 stopping 2018-05-02 06:33:10,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16020] ipc.RpcServer: callId: 8812 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:60976 deadline: 1525242880870, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 stopping 2018-05-02 06:33:10,871 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=11 2018-05-02 06:33:10,871 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,874 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:10,874 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:33:10,874 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:33:10,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,876 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:33:10,876 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 5bd8c2cd29520d0d27cacb48e7436a6d, disabling compactions & flushes 2018-05-02 06:33:10,876 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:10,880 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:33:10,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,883 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:10,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:33:10,883 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 54c783f1faee76bcce84aee6145e82d1, disabling compactions & flushes 2018-05-02 06:33:10,883 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:10,887 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5bd8c2cd29520d0d27cacb48e7436a6d/recovered.edits/12889.seqid, newMaxSeqId=12889, maxSeqId=12887 2018-05-02 06:33:10,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12168.seqid, newMaxSeqId=12168, maxSeqId=12166 2018-05-02 06:33:10,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,890 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:10,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,,1525238855422.5bd8c2cd29520d0d27cacb48e7436a6d. 2018-05-02 06:33:10,891 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 3b0ff50ae790418c1d7b36d704a3c7a8, disabling compactions & flushes 2018-05-02 06:33:10,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:10,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:10,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:33:10,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closing 2e8da78a5421f95de8c75e0053e1d4a0, disabling compactions & flushes 2018-05-02 06:33:10,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:10,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/54c783f1faee76bcce84aee6145e82d1/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,900 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:10,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,P\xD7\x945\xE5\x0Dy8,1525241408832.54c783f1faee76bcce84aee6145e82d1. 2018-05-02 06:33:10,900 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,901 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closing 41c625158570994727f1c92a8606ca6c, disabling compactions & flushes 2018-05-02 06:33:10,901 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:10,906 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:33:10,907 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:33:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,908 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:10,909 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:33:10,909 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:33:10,909 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 06:33:10,909 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:10,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,910 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:10,911 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:33:10,916 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:33:10,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,918 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,919 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:10,919 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:33:10,924 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13416.seqid, newMaxSeqId=13416, maxSeqId=13414 2018-05-02 06:33:10,926 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:33:10,926 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:33:10,926 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:33:10,926 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:10,927 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:33:11,084 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=11,queue=1,port=16020] ipc.RpcServer: callId: 1354 service: ClientService methodName: Get size: 87 connection: 172.27.59.154:35088 deadline: 1525242881084, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 stopping 2018-05-02 06:33:11,090 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751; all regions closed. 2018-05-02 06:33:11,091 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:11,092 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=11,queue=1,port=16020] ipc.RpcServer: callId: 8814 service: ClientService methodName: Get size: 87 connection: 172.27.61.83:60976 deadline: 1525242881092, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 stopping 2018-05-02 06:33:11,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:33:11,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751.meta:.meta(num 1525242781028) 2018-05-02 06:33:11,117 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:11,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:33:11,136 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242527751:(num 1525242541341) 2018-05-02 06:33:11,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:33:11,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 06:33:11,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:33:11,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:33:11,143 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 06:33:11,143 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:33:11,144 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:33:11,166 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 2018-05-02 06:33:11,166 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bf, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:33:11,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x3631f08b27900bf closed 2018-05-02 06:33:11,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751; zookeeper connection closed. 2018-05-02 06:33:11,168 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:33:11,169 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:33:11,173 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:34:31 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:34:34,747 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:34:34,750 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:34:34,750 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:34:34,750 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:34:34,750 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:34:35,604 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:34:35,604 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:34:35,605 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:34:35,605 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:34:35,606 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:34:35,607 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020634 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:34:35,608 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:34:35,609 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:34:35,610 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:35,610 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:34:35,610 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:34:35,611 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020634 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:34:35,613 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:34:35,618 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:34:35,619 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020634, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:34:35,943 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:34:36,629 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:34:36,707 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:34:38,041 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:34:38,046 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:34:38,857 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:38,860 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:34:38,860 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:34:39,029 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:34:39,361 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:34:39,361 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:34:39,431 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:34:40,089 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 06:34:40,159 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:40,163 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:34:40,163 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:34:40,163 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:34:40,164 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:40,164 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:34:40,532 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:34:40,905 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:34:40,954 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:34:41,200 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 06:34:41,822 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:34:41,827 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:34:41,830 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:34:41,858 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:41,873 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:41,903 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:34:44,861 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:34:44,878 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:34:45,019 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:34:45,032 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:34:45,034 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:34:45,036 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:34:45,106 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:34:45,110 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:34:45,132 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:34:45,151 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:34:45 UTC 2018 2018-05-02 06:34:45,151 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:34:45 UTC 2018 2018-05-02 06:34:45,151 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:52:50 UTC 2018 2018-05-02 06:34:45,161 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:34:45,183 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:34:45,212 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900ce, negotiated timeout = 90000 2018-05-02 06:34:45,219 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:34:45,220 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce connected 2018-05-02 06:34:45,291 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:34:45,462 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:34:45,463 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:34:45,463 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:34:45,463 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:34:45,470 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:34:45,605 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:45,628 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:34:45,631 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:34:45,665 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:45,708 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:45,993 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:34:45,993 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:34:45,994 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:34:46,028 INFO [main] util.log: Logging initialized @12937ms 2018-05-02 06:34:46,147 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:34:46,173 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:34:46,174 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:34:46,179 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:34:46,180 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:34:46,181 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:34:46,238 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:34:46,241 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:34:46,396 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:34:46,396 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:34:46,634 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:34:46,643 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:34:46,662 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:34:46,662 INFO [main] server.Server: Started @13572ms 2018-05-02 06:34:46,734 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:34:46,747 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:34:46,784 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:34:46,784 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:34:46,789 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:34:46,857 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x1968ea2a to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:34:46,874 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1865692902@2a36b564 2018-05-02 06:34:46,876 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:34:46,878 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:34:46,880 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:34:46,884 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900cf, negotiated timeout = 90000 2018-05-02 06:34:46,968 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6563dfd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:34:46,972 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4850d3c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 06:34:46,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 06:34:47,002 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:34:47,002 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:34:47,041 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:34:47,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:34:47,305 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:34:47,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:34:47,324 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:34:47,324 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:34:47,335 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:34:47,336 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:34:47,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:34:47,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:34:47,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:34:47,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:34:47,456 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:34:47,456 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:47,456 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:34:47,456 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:34:47,456 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:34:47,457 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:34:47,457 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:34:47,457 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:34:47,468 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:34:47,468 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:34:47,468 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:34:47,468 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:34:47,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:34:47,584 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:34:47,584 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:34:47,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:47,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:47,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:34:47,586 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:34:47,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:34:47,595 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:34:47,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:34:47,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:34:47,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:34:47,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:34:47,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:34:47,597 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:34:47,600 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:47,600 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:47,602 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:34:47,602 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:34:47,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:34:47,603 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:34:47,604 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:34:47,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:34:47,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:34:47,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:34:47,622 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:34:47,959 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:34:48,385 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:34:49,402 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:34:49,403 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:34:51,308 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:34:51,649 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:34:51,650 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:34:51,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:34:51,657 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:34:51,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:34:51,759 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525242722107 with port=16020, startcode=1525242875683 2018-05-02 06:34:51,914 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:34:51,914 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:51,915 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:34:52,063 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:52,088 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:34:52,163 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:34:52,167 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:34:52,173 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:34:52,174 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:34:52,175 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:34:52,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:34:52,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:34:52,297 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:34:52,396 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:34:52,418 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:34:52,736 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:34:52,774 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:34:52,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:34:52,839 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:34:52,861 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:34:52,903 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:34:53,056 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:34:53,057 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:34:53,059 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:34:53,268 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 starting 2018-05-02 06:34:53,270 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:34:53,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:34:53,280 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:34:53,285 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:34:53,290 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:34:53,306 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] other RSs: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] 2018-05-02 06:34:53,375 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x3631f08b27900ce 2018-05-02 06:34:53,375 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:34:53,376 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:34:53,376 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683' 2018-05-02 06:34:53,376 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:34:53,377 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:34:53,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:34:53,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:34:53,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:34:53,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683' 2018-05-02 06:34:53,378 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:34:53,379 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:34:53,379 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:34:53,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:34:53,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:34:56,473 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242875683, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:34:56,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 281 ms, current pipeline: [] 2018-05-02 06:34:56,891 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242875683.1525242896473 2018-05-02 06:34:56,891 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 06:35:08,273 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:35:47,025 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a] zookeeper.ZooKeeper: Session: 0x3631f08b27900cf closed 2018-05-02 06:35:47,026 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1968ea2a-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:36:10,686 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 2018-05-02 06:36:10,723 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 znode expired, triggering replicatorRemoved event 2018-05-02 06:36:10,724 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs Wed May 2 06:36:10 UTC 2018 Terminating regionserver 2018-05-02 06:36:10,983 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:36:10,983 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:36:10,983 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:36:10,983 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:36:10,983 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:36:10,984 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:36:10,984 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:36:10,984 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:36:10,984 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 06:36:10,984 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:36:10,984 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:36:10,984 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:36:10,985 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:10,985 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:36:10,985 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:36:10,985 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:36:10,985 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:36:10,985 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:10,985 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:10,985 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683' ***** 2018-05-02 06:36:10,986 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:10,986 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:10,986 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:10,987 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:10,987 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:10,986 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:36:10,987 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,006 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,035 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:11,036 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:36:11,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:36:11,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:36:11,043 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:36:11,044 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 exiting 2018-05-02 06:36:11,066 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:36:11,081 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:36:11,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:36:11,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:36:11,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:36:11,096 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:36:11,097 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:36:11,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:36:11,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:36:11,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:36:11,103 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:36:11,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x1968ea2a to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:36:11,103 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:11,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683; all regions closed. 2018-05-02 06:36:11,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:36:11,303 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:36:11,303 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525242875683:(num 1525242896473) 2018-05-02 06:36:11,303 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:11,304 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Leases: Closed leases 2018-05-02 06:36:11,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:36:11,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:36:11,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:36:11,312 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:36:11,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.NettyRpcServer: Stopping server on /172.27.59.21:16020 2018-05-02 06:36:11,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:36:11,313 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:36:11,313 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:36:11,396 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:36:11,397 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:11,503 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=Disconnected, path=null 2018-05-02 06:36:11,503 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received Disconnected from ZooKeeper, ignoring 2018-05-02 06:36:11,503 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=Disconnected, path=null 2018-05-02 06:36:11,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ZooKeeper: Session: 0x3631f08b27900ce closed 2018-05-02 06:36:11,503 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900ce, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received Disconnected from ZooKeeper, ignoring 2018-05-02 06:36:11,503 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683; zookeeper connection closed. 2018-05-02 06:36:11,503 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:36:11,503 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:36:11,505 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:37:21 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000007.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1030953 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:37:24,822 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:37:24,825 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:37:24,825 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:37:24,825 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:37:24,825 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:37:25,976 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:37:25,976 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:25,976 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:37:25,976 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:25,978 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:37:25,978 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:37:25,978 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:37:25,979 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:37:25,980 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:37:25,981 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=549572 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:25,982 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:37:25,983 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:37:25,984 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:25,985 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 2018-05-02 06:37:25,985 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:37:25,985 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:37:25,986 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:37:25,989 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:37:25,990 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020637, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000007.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:37:26,258 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:37:27,150 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:37:27,313 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:37:28,103 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:37:28,110 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:37:28,910 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:28,910 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:37:28,910 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:37:29,030 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:37:29,474 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:37:29,474 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:37:29,530 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:37:30,248 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000007:16020 server-side Connection retries=105 2018-05-02 06:37:30,297 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:30,300 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:37:30,300 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:37:30,301 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:37:30,301 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:30,301 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:30,531 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:37:30,857 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:37:30,889 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:37:31,134 INFO [main] ipc.NettyRpcServer: Bind to /172.27.59.21:16020 2018-05-02 06:37:31,799 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:31,807 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:37:31,810 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:37:31,847 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:31,849 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:31,861 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:37:34,105 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:34,119 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:34,225 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:37:34,246 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:37:34,246 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:34,246 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:37:34,246 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:37:34,246 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:37:34,247 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.10.2.el7.x86_64 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:37:34,248 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:37:34,250 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@10cd6753 2018-05-02 06:37:34,325 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:37:34,335 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:37:34,346 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:34,369 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:34,374 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:37:34 UTC 2018 2018-05-02 06:37:34,374 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:37:34 UTC 2018 2018-05-02 06:37:34,374 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:56:09 UTC 2018 2018-05-02 06:37:34,384 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:37:34,400 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900d4, negotiated timeout = 90000 2018-05-02 06:37:34,406 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:37:34,407 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4 connected 2018-05-02 06:37:34,449 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:37:34,582 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:37:34,582 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:37:34,583 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:37:34,595 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:34,769 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:34,804 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:37:34,809 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:37:34,865 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:34,918 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:35,040 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:37:35,041 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:35,041 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:35,099 INFO [main] util.log: Logging initialized @12146ms 2018-05-02 06:37:35,398 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:37:35,435 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:37:35,436 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:37:35,443 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:37:35,443 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:37:35,444 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:37:35,515 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:37:35,518 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:37:35,601 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@26cb5207{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:37:35,602 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:37:36,011 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@71e4b308{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:37:36,028 INFO [main] ssl.SslContextFactory: x509=X509@4cc36c19(ctr-e138-1518143905142-279227-01-000007.hwx.site,h=[ctr-e138-1518143905142-279227-01-000007.hwx.site],w=[]) for SslContextFactory@5a3a1bf9(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:37:36,054 INFO [main] server.AbstractConnector: Started ServerConnector@51ec2856{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:37:36,054 INFO [main] server.Server: Started @13102ms 2018-05-02 06:37:36,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:37:36,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:37:36,150 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:37:36,150 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:37:36,157 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:37:36,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] zookeeper.ReadOnlyZKClient: Connect 0x3de629f3 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:37:36,227 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1988798223@338837ba 2018-05-02 06:37:36,229 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:36,231 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:36,232 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:37:36,235 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900d1, negotiated timeout = 90000 2018-05-02 06:37:36,303 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@701cfa84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:37:36,306 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@635ced52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:0 2018-05-02 06:37:36,319 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000007:16020 2018-05-02 06:37:36,340 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:37:36,341 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:37:36,365 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:36,365 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:37:36,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:37:36,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:37:36,368 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:37:36,368 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:37:36,369 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:37:36,643 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:37:36,646 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:37:36,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:37:36,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:37:36,657 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:37:36,658 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:37:36,704 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:37:36,705 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:37:36,714 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:37:36,714 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:37:36,715 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:36,715 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:37:36,715 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:37:36,715 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:37:36,715 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:37:36,716 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:36,716 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:37:36,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:36,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:37:36,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:37:36,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:36,777 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:37:36,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:37:36,822 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:37:36,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:36,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:36,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:37:36,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:37:36,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:37:36,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:37:36,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:37:36,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:37:36,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:37:36,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:37:36,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:37:36,835 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:36,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:36,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:37:36,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:37:36,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:37:36,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:37:36,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:37:36,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:37:36,851 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:37:36,853 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:37:37,055 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:37,465 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:39,528 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:37:39,529 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:37:40,923 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:37:41,170 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:37:41,170 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:41,172 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:41,175 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:37:41,176 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:37:41,200 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525243032003 with port=16020, startcode=1525243046037 2018-05-02 06:37:41,343 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:37:41,344 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:41,349 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:37:41,535 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:41,558 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:37:41,598 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:37:41,602 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:37:41,605 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:37:41,606 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:37:41,607 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:37:41,684 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:41,684 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:37:41,684 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:37:41,737 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:37:41,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:42,478 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:37:42,510 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:37:42,599 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:37:42,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:37:42,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:37:42,680 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:37:42,746 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:37:42,746 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:37:42,746 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:37:42,748 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:37:42,748 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:37:42,751 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:37:42,753 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:37:42,756 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000007:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:37:42,856 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000007:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 starting 2018-05-02 06:37:42,866 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:37:42,872 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:37:42,877 WARN [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:37:42,883 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:37:42,887 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:37:42,921 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037] 2018-05-02 06:37:42,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, RpcServer on ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:16020, sessionid=0x3631f08b27900d4 2018-05-02 06:37:42,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:37:42,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:42,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037' 2018-05-02 06:37:42,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:37:42,983 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:37:42,984 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:37:42,984 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:37:42,984 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:42,985 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037' 2018-05-02 06:37:42,985 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:37:42,985 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:37:42,986 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:37:42,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:37:42,986 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:37:46,102 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525243046037, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:37:46,999 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Slow sync cost: 687 ms, current pipeline: [] 2018-05-02 06:37:47,000 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525243046037.1525243066104 2018-05-02 06:37:47,000 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 06:37:52,535 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:37:52,543 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:52,543 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:52,554 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:52,571 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:52,572 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:52,574 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:52,575 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:52,575 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:52,812 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 06:37:52,817 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:37:52,837 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525243046037.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:37:52,894 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037/ctr-e138-1518143905142-279227-01-000007.hwx.site%2C16020%2C1525243046037.meta.1525243072838.meta 2018-05-02 06:37:52,894 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:37:52,955 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:37:53,047 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 06:37:53,053 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:53,059 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 06:37:53,060 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:53,060 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:53,060 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:53,060 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 06:37:53,067 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:53,067 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:53,072 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 06:37:53,076 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 06:37:53,076 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 06:37:53,112 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 06:37:53,112 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 06:37:53,310 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:37:53,310 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:37:53,387 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:53,435 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:53,903 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1 2018-05-02 06:37:53,945 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8 2018-05-02 06:37:53,979 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902 2018-05-02 06:37:53,987 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:53,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:37:53,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:37:53,999 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:54,001 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:54,064 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/1c4610df23af45aebb0c862393f196e4 2018-05-02 06:37:54,065 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:54,093 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 06:37:54,134 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 06:37:54,181 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/3170.seqid, newMaxSeqId=3170, maxSeqId=3169 2018-05-02 06:37:54,187 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=3170 2018-05-02 06:37:54,257 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 06:37:54,264 DEBUG [PostOpenDeployTasks:1588230740] regionserver.CompactSplit: Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:37:54,276 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:54,294 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] compactions.SortedCompactionPolicy: Selecting compaction from 3 store files, 0 compacting, 3 eligible, 10 blocking 2018-05-02 06:37:54,317 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 06:37:54,319 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:54,321 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] compactions.ExploringCompactionPolicy: Exploring compaction algorithm has selected 3 files of size 701563 starting at candidate #701563 after considering 1 permutations with 1 in ratio 2018-05-02 06:37:54,328 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.HStore: 1588230740 - info: Initiating minor compaction (all files) 2018-05-02 06:37:54,329 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.HRegion: Starting compaction of info in hbase:meta,,1.1588230740 2018-05-02 06:37:54,330 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.HStore: Starting compaction of [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1] into tmpdir=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=685.1 K 2018-05-02 06:37:54,335 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] compactions.Compactor: Compacting 608674def2b442d49e864e4c9256f9b8, keycount=2412, bloomtype=NONE, size=399.9 K, encoding=NONE, seqNum=2735, earliestPutTs=1525241057063 2018-05-02 06:37:54,338 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] compactions.Compactor: Compacting d45d8a90947747948c7ad2c68791e902, keycount=600, bloomtype=NONE, size=103.5 K, encoding=NONE, seqNum=2892, earliestPutTs=1525242792201 2018-05-02 06:37:54,342 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] compactions.Compactor: Compacting 2e9a119565314b11b7defc35c2e8edf1, keycount=1072, bloomtype=NONE, size=181.7 K, encoding=NONE, seqNum=3166, earliestPutTs=1525242860798 2018-05-02 06:37:54,538 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:37:54,541 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:54,541 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:54,544 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:54,547 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:54,547 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:54,549 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:54,549 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:54,549 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:54,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:54,606 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:37:55,060 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] throttle.PressureAwareThroughputController: 1588230740#info#compaction#0 average throughput is 0.91 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 10.00 MB/second 2018-05-02 06:37:55,212 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/6e5656381f8446b6aab4f349ca9e3e29 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/6e5656381f8446b6aab4f349ca9e3e29 2018-05-02 06:37:55,359 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.HStore: Completed compaction of 3 (all) file(s) in info of 1588230740 into 6e5656381f8446b6aab4f349ca9e3e29(size=399.8 K), total size for store is 399.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2018-05-02 06:37:55,359 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.CompactSplit: Completed compaction region=hbase:meta,,1.1588230740, storeName=info, priority=7, startTime=1525243074263; duration=1sec 2018-05-02 06:37:55,363 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-shortCompactions-1525243074263] regionserver.CompactSplit: Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2018-05-02 06:37:56,857 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:37:56,994 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:37:56,996 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 70ed82a86a0f0c62d692e8ffd1c0f904, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:37:56,996 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AuthenticationService 2018-05-02 06:37:56,997 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:56,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=SecureBulkLoadService 2018-05-02 06:37:56,997 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:56,997 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:56,997 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:56,998 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AccessControlService 2018-05-02 06:37:57,000 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,000 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:37:57,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:37:57,001 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,007 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:37:57,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:37:57,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:37:57,009 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:37:57,009 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,009 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,009 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:37:57,010 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,010 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:37:57,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:37:57,027 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:37:57,029 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:37:57,030 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 06:37:57,030 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,030 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 06:37:57,030 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,030 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,030 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,030 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 06:37:57,031 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,031 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,031 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:37:57,031 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:37:57,032 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,034 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:37:57,034 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:37:57,036 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,037 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,059 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,060 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:37:57,061 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:37:57,075 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:37:57,075 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:37:57,076 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,077 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:37:57,079 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,086 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,102 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:37:57,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:37:57,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 06:37:57,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 06:37:57,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,107 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,107 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => e8edde5a00b30c080b02d1b096794b39, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:37:57,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 06:37:57,108 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,108 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:37:57,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:37:57,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AuthenticationService 2018-05-02 06:37:57,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=SecureBulkLoadService 2018-05-02 06:37:57,109 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,109 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,109 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AccessControlService 2018-05-02 06:37:57,110 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,110 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:37:57,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:37:57,110 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/41.seqid, newMaxSeqId=41, maxSeqId=40 2018-05-02 06:37:57,126 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:37:57,128 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=41 2018-05-02 06:37:57,150 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:37:57,153 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:37:57,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 9f9b6704233f2d2e06a5634fda7f94ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:37:57,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AuthenticationService 2018-05-02 06:37:57,155 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=SecureBulkLoadService 2018-05-02 06:37:57,155 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,155 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,155 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AccessControlService 2018-05-02 06:37:57,155 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,156 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:37:57,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:37:57,158 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:37:57,158 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:37:57,158 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:37:57,159 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,159 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,160 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,161 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:37:57,161 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:37:57,162 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,165 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,172 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:37:57,172 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:37:57,173 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:37:57,173 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,173 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:37:57,173 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:37:57,173 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,173 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,174 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,174 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,174 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:37:57,174 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,174 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,184 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,187 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:37:57,188 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:37:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:37:57,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:37:57,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,213 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:37:57,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:37:57,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:37:57,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:37:57,214 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,214 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:37:57,215 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:37:57,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:37:57,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 06:37:57,216 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 06:37:57,216 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,216 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,216 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 06:37:57,217 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,217 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:37:57,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:37:57,218 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,218 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,218 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:37:57,218 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:37:57,219 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,224 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:37:57,224 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:37:57,226 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,228 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,268 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:37:57,269 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:37:57,270 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:37:57,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:37:57,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:37:57,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:37:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:37:57,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:37:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:37:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,271 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:37:57,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opening region: {ENCODED => 1bf9126ca1d7eb9abb934165d5f25857, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:37:57,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AuthenticationService 2018-05-02 06:37:57,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=SecureBulkLoadService 2018-05-02 06:37:57,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AccessControlService 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:37:57,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,273 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:37:57,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:37:57,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:37:57,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,274 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:37:57,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:37:57,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:37:57,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:37:57,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 06:37:57,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 06:37:57,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 06:37:57,276 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:37:57,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:37:57,277 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:37:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:37:57,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,274 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:37:57,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,282 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:37:57,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:37:57,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:37:57,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,295 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:37:57,295 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:37:57,297 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,298 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:37:57,329 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 06:37:57,329 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,333 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1/977dea08c07d4c3986cb36260a1abca4 2018-05-02 06:37:57,333 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,351 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:37:57,351 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:37:57,354 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,356 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,357 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1/3d0f7026a4ef4c89aa664ab8b925b29f 2018-05-02 06:37:57,357 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,361 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:37:57,361 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:37:57,363 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,364 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,364 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:37:57,364 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:37:57,365 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:37:57,365 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:37:57,365 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,366 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,366 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,369 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,374 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:37:57,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:37:57,376 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:37:57,377 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:37:57,378 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,379 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:37:57,388 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:37:57,388 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:37:57,390 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 70ed82a86a0f0c62d692e8ffd1c0f904; next sequenceid=417 2018-05-02 06:37:57,391 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,408 INFO [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:37:57,414 DEBUG [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:37:57,414 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,427 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:37:57,427 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:37:57,435 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,444 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:37:57,446 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,470 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:37:57,471 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,521 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:37:57,526 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 06:37:57,526 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,527 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:37:57,527 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:57,571 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 06:37:57,571 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,572 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:37:57,572 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,574 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12260.seqid, newMaxSeqId=12260, maxSeqId=12259 2018-05-02 06:37:57,575 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:37:57,575 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=12260 2018-05-02 06:37:57,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:37:57,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=426 2018-05-02 06:37:57,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:57,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:37:57,607 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:37:57,612 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:37:57,616 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:37:57,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:37:57,619 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:37:57,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 9f9b6704233f2d2e06a5634fda7f94ca; next sequenceid=426 2018-05-02 06:37:57,622 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened e8edde5a00b30c080b02d1b096794b39; next sequenceid=417 2018-05-02 06:37:57,622 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1/39f70bcc389446a6a85d27019cee494f 2018-05-02 06:37:57,622 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,626 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:37:57,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,629 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:37:57,635 INFO [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:37:57,635 INFO [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:37:57,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:37:57,642 DEBUG [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:37:57,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,645 DEBUG [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:37:57,647 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:37:57,679 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:37:57,689 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:37:57,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opening region: {ENCODED => 843b3b66a19c1c2d494720e99edc9c52, NAME => 'test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:37:57,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AuthenticationService 2018-05-02 06:37:57,696 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=SecureBulkLoadService 2018-05-02 06:37:57,703 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,703 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,703 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AccessControlService 2018-05-02 06:37:57,704 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,704 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:37:57,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:37:57,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,706 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:37:57,729 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:37:57,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opening region: {ENCODED => a47cc34ca47759b3fd7bcaa79faebd3d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:37:57,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AuthenticationService 2018-05-02 06:37:57,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=SecureBulkLoadService 2018-05-02 06:37:57,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AccessControlService 2018-05-02 06:37:57,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:37:57,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:37:57,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,735 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:37:57,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:37:57,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:37:57,737 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:37:57,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,755 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,755 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:37:57,756 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,756 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,756 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:37:57,757 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:37:57,757 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,760 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12175.seqid, newMaxSeqId=12175, maxSeqId=12174 2018-05-02 06:37:57,773 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:37:57,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:37:57,775 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:37:57,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11486.seqid, newMaxSeqId=11486, maxSeqId=11485 2018-05-02 06:37:57,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:37:57,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:37:57,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:37:57,776 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,776 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:37:57,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:37:57,776 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,776 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:37:57,777 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,777 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:37:57,779 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:37:57,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:37:57,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:37:57,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:37:57,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:37:57,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 06:37:57,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:57,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 06:37:57,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:57,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:57,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:57,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 06:37:57,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:57,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:57,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 06:37:57,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:37:57,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:57,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/432.seqid, newMaxSeqId=432, maxSeqId=431 2018-05-02 06:37:57,831 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12175 2018-05-02 06:37:57,840 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11486 2018-05-02 06:37:57,878 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:37:57,879 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:37:57,878 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=432 2018-05-02 06:37:57,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12336.seqid, newMaxSeqId=12336, maxSeqId=12335 2018-05-02 06:37:57,882 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,883 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,884 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:37:57,884 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:57,879 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:37:57,885 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:37:57,885 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:37:57,890 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:37:57,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,893 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,900 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13019.seqid, newMaxSeqId=13019, maxSeqId=13018 2018-05-02 06:37:57,893 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:37:57,901 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:37:57,901 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,905 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:37:57,905 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12336 2018-05-02 06:37:57,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,911 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:37:57,911 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:37:57,925 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:37:57,926 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:37:57,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=13019 2018-05-02 06:37:57,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12471.seqid, newMaxSeqId=12471, maxSeqId=12470 2018-05-02 06:37:57,935 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:37:57,941 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:37:57,941 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:37:57,941 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:37:57,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12471 2018-05-02 06:37:57,942 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,942 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:57,942 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,943 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,943 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:57,946 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@668c49d7 2018-05-02 06:37:57,958 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:37:57,973 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:37:57,973 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:57,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:57,977 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:37:57,977 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:37:57,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:57,979 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:37:57,982 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0114, negotiated timeout = 10000 2018-05-02 06:37:57,991 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:37:57,991 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,009 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] regionserver.HRegion: Opened 1bf9126ca1d7eb9abb934165d5f25857; next sequenceid=423 2018-05-02 06:37:58,013 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:37:58,013 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:37:58,016 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,017 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,019 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:37:58,019 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:37:58,021 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,021 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,022 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:37:58,026 INFO [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:37:58,043 DEBUG [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:37:58,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,043 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:37:58,048 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opening region: {ENCODED => 51119cebc42546d1c9f2590eec5a49b3, NAME => 'test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:37:58,049 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AuthenticationService 2018-05-02 06:37:58,050 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=SecureBulkLoadService 2018-05-02 06:37:58,050 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,050 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,051 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AccessControlService 2018-05-02 06:37:58,051 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,051 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:37:58,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:37:58,052 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,052 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:37:58,053 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,059 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:37:58,059 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:37:58,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:37:58,060 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 06:37:58,060 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,060 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 06:37:58,060 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,060 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,060 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 06:37:58,061 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,061 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:37:58,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:37:58,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:37:58,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:37:58,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 06:37:58,062 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,062 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 06:37:58,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 06:37:58,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:37:58,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:37:58,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:37:58,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 06:37:58,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:37:58,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,070 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1/21db71a596184e8987d3b0a857d2a3d8 2018-05-02 06:37:58,070 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,081 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:37:58,112 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:37:58,116 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:37:58,117 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:37:58,118 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:37:58,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:37:58,397 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 266 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:37:58,398 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 238 ms, current pipeline: [DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:37:58,426 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:37:58,460 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:37:58,465 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:37:58,465 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,468 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:37:58,468 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:37:58,470 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,471 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,479 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:37:58,479 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:37:58,480 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,481 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,483 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:37:58,483 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,487 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:37:58,487 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:37:58,488 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,489 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:37:58,491 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:37:58,491 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:37:58,492 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:37:58,496 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,501 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,504 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=429 2018-05-02 06:37:58,510 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:37:58,515 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:37:58,520 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:37:58,520 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,538 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:37:58,555 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:37:58,564 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:37:58,580 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:37:58,581 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opening region: {ENCODED => 7524beb6ac348dac037dbf298ba07495, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:37:58,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AuthenticationService 2018-05-02 06:37:58,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=SecureBulkLoadService 2018-05-02 06:37:58,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AccessControlService 2018-05-02 06:37:58,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 7524beb6ac348dac037dbf298ba07495 2018-05-02 06:37:58,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:37:58,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,610 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:37:58,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 06:37:58,615 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 06:37:58,615 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,626 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:37:58,637 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] regionserver.HRegion: Opened a47cc34ca47759b3fd7bcaa79faebd3d; next sequenceid=420 2018-05-02 06:37:58,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:37:58,663 INFO [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:37:58,668 DEBUG [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:37:58,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,682 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:37:58,683 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,686 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 06:37:58,696 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 06:37:58,700 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:37:58,705 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 06:37:58,705 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,709 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:37:58,709 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:37:58,713 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:58,714 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:58,725 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] regionserver.HRegion: Opened 843b3b66a19c1c2d494720e99edc9c52; next sequenceid=423 2018-05-02 06:37:58,737 INFO [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:37:58,747 DEBUG [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:37:58,747 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12816.seqid, newMaxSeqId=12816, maxSeqId=12815 2018-05-02 06:37:58,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:37:58,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:37:58,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:37:58,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=19 2018-05-02 06:37:58,820 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:37:58,821 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,824 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12816 2018-05-02 06:37:58,830 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=420 2018-05-02 06:37:58,833 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:37:58,834 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=20 2018-05-02 06:37:58,841 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:37:58,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,845 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:37:58,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:37:58,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/432.seqid, newMaxSeqId=432, maxSeqId=431 2018-05-02 06:37:58,863 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:37:58,863 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,874 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:37:58,874 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1/1d1b806509a34e0c9777f7096fbc3f1c 2018-05-02 06:37:58,876 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:58,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/432.seqid, newMaxSeqId=432, maxSeqId=431 2018-05-02 06:37:58,878 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:37:58,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,881 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=432 2018-05-02 06:37:58,893 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:37:58,905 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:37:58,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,950 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:37:58,952 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495 2018-05-02 06:37:58,953 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=432 2018-05-02 06:37:58,954 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11899.seqid, newMaxSeqId=11899, maxSeqId=11898 2018-05-02 06:37:58,959 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/432.seqid, newMaxSeqId=432, maxSeqId=431 2018-05-02 06:37:58,964 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:37:58,969 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opening region: {ENCODED => 385c8f00672f754fa0d7448f5ac543fa, NAME => 'test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:37:58,969 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AuthenticationService 2018-05-02 06:37:58,969 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:37:58,969 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=SecureBulkLoadService 2018-05-02 06:37:58,969 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:37:58,969 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:37:58,969 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:37:58,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. service=AccessControlService 2018-05-02 06:37:58,970 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:37:58,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:37:58,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:37:58,970 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:37:58,971 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:37:58,971 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11899 2018-05-02 06:37:58,972 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:37:58,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=432 2018-05-02 06:37:58,982 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:37:58,986 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:37:58,988 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:37:58,989 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,992 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:37:58,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:58,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:37:59,018 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] regionserver.HRegion: Opened 51119cebc42546d1c9f2590eec5a49b3; next sequenceid=426 2018-05-02 06:37:59,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:37:59,024 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:37:59,024 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1 2018-05-02 06:37:59,029 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] regionserver.HRegion: Opened 7524beb6ac348dac037dbf298ba07495; next sequenceid=423 2018-05-02 06:37:59,034 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=131, currentSize=1.25 MB, freeSize=203.55 MB, maxSize=204.80 MB, heapSize=1.25 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:59,041 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:37:59,054 INFO [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:37:59,064 DEBUG [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:37:59,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:59,092 INFO [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:37:59,097 DEBUG [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:37:59,098 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:59,149 DEBUG [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/f1/20cc702a3aaf4197b9dd17722b21fc36 2018-05-02 06:37:59,150 INFO [StoreOpener-385c8f00672f754fa0d7448f5ac543fa-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:37:59,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa 2018-05-02 06:37:59,221 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/385c8f00672f754fa0d7448f5ac543fa/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:37:59,227 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] regionserver.HRegion: Opened 385c8f00672f754fa0d7448f5ac543fa; next sequenceid=423 2018-05-02 06:37:59,240 INFO [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:37:59,252 DEBUG [PostOpenDeployTasks:385c8f00672f754fa0d7448f5ac543fa] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. 2018-05-02 06:37:59,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525239890069.385c8f00672f754fa0d7448f5ac543fa. on ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:37:59,825 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:37:59,825 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:37:59,928 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:59,929 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:37:59,929 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:37:59,945 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:37:59,973 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:37:59,973 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:38:00,083 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:38:00,083 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:38:00,084 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:38:00,084 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:38:00,085 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:38:00,085 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 06:38:00,096 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:38:00,096 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:38:00,608 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,608 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,608 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,608 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:00,608 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:03,052 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:38:03,056 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:38:03,060 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:38:03,570 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:38:04,209 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:38:04,210 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:38:04,321 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:38:04,321 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:38:04,321 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:38:04,338 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:38:04,347 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:38:04,347 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:38:05,477 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:38:05,479 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:38:05,479 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,481 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:38:05,483 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,484 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:38:05,485 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,486 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:05,486 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:38:05,487 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:38:05,489 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:38:05,489 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,492 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:38:05,493 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,493 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:38:05,494 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:05,494 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:38:05,495 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:38:36,263 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3] zookeeper.ZooKeeper: Session: 0x2631f08d93900d1 closed 2018-05-02 06:38:36,263 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3de629f3-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:38:36,856 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.032 minutes, events=12, succcessCount=6, totalEvents=12, totalSuccessCount=6 2018-05-02 06:38:47,416 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:47,422 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:47,778 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:38:50,783 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:38:50,783 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:50,783 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:38:50,785 DEBUG [RS-EventLoopGroup-1-8] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:50,792 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:38:50,841 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:38:50,841 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:38:50,842 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:38:50,843 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:38:50,843 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:39:24,057 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:39:24,058 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:39:24,058 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,060 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:39:24,065 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,065 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:39:24,068 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,068 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:39:24,068 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:39:24,104 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2018-05-02 06:39:24,463 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000007.hwx.site@EXAMPLE.COM 2018-05-02 06:39:24,464 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:39:24,464 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,466 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:39:24,470 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,470 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:39:24,472 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:39:24,472 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:39:24,472 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:39:42,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] regionserver.HStore: Moving the files [hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1] to archive 2018-05-02 06:39:42,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archiving compacted files. 2018-05-02 06:39:42,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8 2018-05-02 06:39:42,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902 2018-05-02 06:39:42,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000007:16020-9] backup.HFileArchiver: Archived from FileableStoreFile, hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1 to hdfs://mycluster/apps/hbase/data/archive/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1 2018-05-02 06:40:12,002 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,003 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:40:12,006 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,007 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,008 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037 2018-05-02 06:40:12,009 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 14 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:40:12,021 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900d4, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/13 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:42:31,833 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=573.13 KB, freeSize=204.24 MB, max=204.80 MB, blockCount=49, accesses=521, hits=308, hitRatio=59.12%, , cachingAccesses=439, cachingHits=308, cachingHitsRatio=70.16%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:42:42,887 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=1, reused chunk count=0, reuseRatio=0.00% 2018-05-02 06:42:42,888 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000007:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:42:58,111 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:42:58,112 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:42:58,117 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:42:58,625 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:42:58,878 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:42:58,879 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000007.hwx.site, serviceName = hbase 2018-05-02 06:42:58,951 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:42:58,951 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:42:58,951 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:42:58,956 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:42:58,958 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:42:58,958 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:43:02,776 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 147729ms 2018-05-02 06:43:12,759 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 275077ms 2018-05-02 06:43:22,793 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 255348ms 2018-05-02 06:43:32,758 INFO [regionserver/ctr-e138-1518143905142-279227-01-000007:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 10926ms