Thu Mar 24 01:43:08 CST 2022 Starting master on C1HM1 core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 512460 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1048576 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2022-03-24 01:43:16,689 INFO [main] master.HMaster: STARTING service HMaster 2022-03-24 01:43:16,714 INFO [main] util.VersionInfo: HBase 2.4.8 2022-03-24 01:43:16,715 INFO [main] util.VersionInfo: Source code repository git://apurtell-ltm.internal.salesforce.com/Users/apurtell/tmp/RM/hbase revision=f844d09157d9dce6c54fcd53975b7a45865ee9ac 2022-03-24 01:43:16,715 INFO [main] util.VersionInfo: Compiled by apurtell on Wed Oct 27 08:48:57 PDT 2021 2022-03-24 01:43:16,716 INFO [main] util.VersionInfo: From source with checksum f575ee5f53f2f967078b59695c66493807de773ea5bd8dbf33b5574d8141d6d9720858a993b91466f188276b00c2a1cfc1a4b8fb7e1b9e65f2d99d62fa7de054 2022-03-24 01:43:19,042 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /home/hbuser/evaluation/hbase-2.4.8/tmp 2022-03-24 01:43:19,042 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://C1hb-hdfs:9000/hbase 2022-03-24 01:43:19,043 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2022-03-24 01:43:19,043 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: C1hb-zk 2022-03-24 01:43:19,046 INFO [main] util.ServerCommandLine: env:PATH=/home/hbuser/java/jdk1.8.0_271/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2022-03-24 01:43:19,047 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-root-master-C1HM1.log 2022-03-24 01:43:19,048 INFO [main] util.ServerCommandLine: env:FAV_OPTS=-Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=true,useMsgid=false,jdkMsg=false,jdkFile=true,recordPhase=false,recordPath=/home/hbuser/hb244-fav-rst/,dataPaths=/home/hbuser/evaluation/hbase-2.4.8/tmp:/home/hbuser/evaluation/hbase-2.4.8/conf,cacheDir=/home/hbuser/HB244-CacheFolder,favHome=/home/hbuser,hdfsApi=true,zkApi=true,forHbase=true,currentCrash=/home/hbuser/hb244curCrash,controllerSocket=124.16.138.61:14900,strictCheck=false,mapSize=10000,wordSize=64,covPath=/home/hbuser/fuzzcov,covIncludes=org/apache/hadoop/hbase,aflAllow=/home/hbuser/evaluation/hbase-2.4.8/allowlist,aflDeny=/home/hbuser/evaluation/hbase-2.4.8/denylist,aflPort=12181 2022-03-24 01:43:19,048 INFO [main] util.ServerCommandLine: env:MSG_OPT=false 2022-03-24 01:43:19,049 INFO [main] util.ServerCommandLine: env:HBASE_ZOOKEEPER_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,050 INFO [main] util.ServerCommandLine: env:FAV_HOME=/home/hbuser 2022-03-24 01:43:19,050 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=true,useMsgid=false,jdkMsg=false,jdkFile=true,recordPhase=false,recordPath=/home/hbuser/hb244-fav-rst/,dataPaths=/home/hbuser/evaluation/hbase-2.4.8/tmp:/home/hbuser/evaluation/hbase-2.4.8/conf,cacheDir=/home/hbuser/HB244-CacheFolder,favHome=/home/hbuser,hdfsApi=true,zkApi=true,forHbase=true,currentCrash=/home/hbuser/hb244curCrash,controllerSocket=124.16.138.61:14900,strictCheck=false,mapSize=10000,wordSize=64,covPath=/home/hbuser/fuzzcov,covIncludes=org/apache/hadoop/hbase,aflAllow=/home/hbuser/evaluation/hbase-2.4.8/allowlist,aflDeny=/home/hbuser/evaluation/hbase-2.4.8/denylist,aflPort=12181 -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,051 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/home/hbuser/fav-jre-inst 2022-03-24 01:43:19,051 INFO [main] util.ServerCommandLine: env:TERM=xterm 2022-03-24 01:43:19,052 INFO [main] util.ServerCommandLine: env:JRE_HOME=/home/hbuser/java/jdk1.8.0_271/jre 2022-03-24 01:43:19,052 INFO [main] util.ServerCommandLine: env:HBASE_SHELL_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,053 INFO [main] util.ServerCommandLine: env:JVM_PID=182 2022-03-24 01:43:19,053 INFO [main] util.ServerCommandLine: env:TIME_OPTS=-Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,054 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,054 INFO [main] util.ServerCommandLine: env:PWD=/home/hbuser/evaluation/hbase-2.4.8 2022-03-24 01:43:19,055 INFO [main] util.ServerCommandLine: env:JRUBY_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true 2022-03-24 01:43:19,055 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2022-03-24 01:43:19,056 INFO [main] util.ServerCommandLine: env:PHOS_OPTS=-Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true 2022-03-24 01:43:19,056 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2022-03-24 01:43:19,057 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=root 2022-03-24 01:43:19,057 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/tmp/hbase-root-master.znode 2022-03-24 01:43:19,058 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-root-master-C1HM1 2022-03-24 01:43:19,058 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/home/hbuser/evaluation/hbase-2.4.8/bin/../logs 2022-03-24 01:43:19,059 INFO [main] util.ServerCommandLine: env:OLDPWD=/ 2022-03-24 01:43:19,059 INFO [main] util.ServerCommandLine: env:USER=root 2022-03-24 01:43:19,060 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=true,useMsgid=false,jdkMsg=false,jdkFile=true,recordPhase=false,recordPath=/home/hbuser/hb244-fav-rst/,dataPaths=/home/hbuser/evaluation/hbase-2.4.8/tmp:/home/hbuser/evaluation/hbase-2.4.8/conf,cacheDir=/home/hbuser/HB244-CacheFolder,favHome=/home/hbuser,hdfsApi=true,zkApi=true,forHbase=true,currentCrash=/home/hbuser/hb244curCrash,controllerSocket=124.16.138.61:14900,strictCheck=false,mapSize=10000,wordSize=64,covPath=/home/hbuser/fuzzcov,covIncludes=org/apache/hadoop/hbase,aflAllow=/home/hbuser/evaluation/hbase-2.4.8/allowlist,aflDeny=/home/hbuser/evaluation/hbase-2.4.8/denylist,aflPort=12181 -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,062 INFO [main] util.ServerCommandLine: py-java-1.0.5.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/spymemcached-2.12.2.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/stax2-api-3.1.4.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/woodstox-core-5.0.3.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/xmlenc-0.52.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/zookeeper-3.5.7.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/zookeeper-jute-3.5.7.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.30.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/slf4j-log4j12-1.7.30.jar 2022-03-24 01:43:19,062 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2022-03-24 01:43:19,063 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/tmp/hbase-root-master.autostart 2022-03-24 01:43:19,063 INFO [main] util.ServerCommandLine: env:SED=sed 2022-03-24 01:43:19,064 INFO [main] util.ServerCommandLine: env:HOSTNAME=C1HM1 2022-03-24 01:43:19,064 INFO [main] util.ServerCommandLine: env:GREP=grep 2022-03-24 01:43:19,065 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2022-03-24 01:43:19,065 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2022-03-24 01:43:19,066 INFO [main] util.ServerCommandLine: Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=true,useMsgid=false,jdkMsg=false,jdkFile=true,recordPhase=false,recordPath=/home/hbuser/hb244-fav-rst/,dataPaths=/home/hbuser/evaluation/hbase-2.4.8/tmp:/home/hbuser/evaluation/hbase-2.4.8/conf,cacheDir=/home/hbuser/HB244-CacheFolder,favHome=/home/hbuser,hdfsApi=true,zkApi=true,forHbase=true,currentCrash=/home/hbuser/hb244curCrash,controllerSocket=124.16.138.61:14900,strictCheck=false,mapSize=10000,wordSize=64,covPath=/home/hbuser/fuzzcov,covIncludes=org/apache/hadoop/hbase,aflAllow=/home/hbuser/evaluation/hbase-2.4.8/allowlist,aflDeny=/home/hbuser/evaluation/hbase-2.4.8/denylist,aflPort=12181 -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 -Dhbase.log.dir=/home/hbuser/evaluation/hbase-2.4.8/bin/../logs -Dhbase.log.file=hbase-root-master-C1HM1.log -Dhbase.home.dir=/home/hbuser/evaluation/hbase-2.4.8/bin/.. -Dhbase.id.str=root -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS 2022-03-24 01:43:19,067 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/home/hbuser/evaluation/hbase-2.4.8/bin/.. 2022-03-24 01:43:19,067 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= -Xbootclasspath/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=false,hbaseRpc=true -Dfile.encoding=UTF8 -Duser.timezone=GMT+08 2022-03-24 01:43:19,068 INFO [main] util.ServerCommandLine: eb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36: 2022-03-24 01:43:19,068 INFO [main] util.ServerCommandLine: env:SHLVL=1 2022-03-24 01:43:19,069 INFO [main] util.ServerCommandLine: env:HOME=/root 2022-03-24 01:43:19,069 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2022-03-24 01:43:19,070 INFO [main] util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.271-b09 2022-03-24 01:43:19,072 INFO [main] util.ServerCommandLine: path/a:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar, -javaagent:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar=useFav=true,useMsgid=false,jdkMsg=false,jdkFile=true,recordPhase=false,recordPath=/home/hbuser/hb244-fav-rst/,dataPaths=/home/hbuser/evaluation/hbase-2.4.8/tmp:/home/hbuser/evaluation/hbase-2.4.8/conf,cacheDir=/home/hbuser/HB244-CacheFolder,favHome=/home/hbuser,hdfsApi=true,zkApi=true,forHbase=true,currentCrash=/home/hbuser/hb244curCrash,controllerSocket=124.16.138.61:14900,strictCheck=false,mapSize=10000,wordSize=64,covPath=/home/hbuser/fuzzcov,covIncludes=org/apache/hadoop/hbase,aflAllow=/home/hbuser/evaluation/hbase-2.4.8/allowlist,aflDeny=/home/hbuser/evaluation/hbase-2.4.8/denylist,aflPort=12181, -Dfile.encoding=UTF8, -Duser.timezone=GMT+08, -Dhbase.log.dir=/home/hbuser/evaluation/hbase-2.4.8/bin/../logs, -Dhbase.log.file=hbase-root-master-C1HM1.log, -Dhbase.home.dir=/home/hbuser/evaluation/hbase-2.4.8/bin/.., -Dhbase.id.str=root, -Dhbase.root.logger=INFO,RFA, -Dhbase.security.logger=INFO,RFAS] 2022-03-24 01:43:25,405 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2022-03-24 01:43:25,861 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2022-03-24 01:43:36,268 INFO [main] regionserver.RSRpcServices: master/C1HM1:16000 server-side Connection retries=45 2022-03-24 01:43:36,837 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2022-03-24 01:43:36,864 INFO [main] ipc.RpcExecutor: Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2022-03-24 01:43:36,865 INFO [main] ipc.RWQueueRpcExecutor: priority.RWQ.Fifo writeQueues=1 writeHandlers=2 readQueues=1 readHandlers=18 scanQueues=0 scanHandlers=0 2022-03-24 01:43:36,866 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2022-03-24 01:43:36,867 INFO [main] ipc.RpcExecutor: Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=1 2022-03-24 01:43:38,879 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2022-03-24 01:43:39,663 INFO [main] Configuration.deprecation: hbase.ipc.server.reservoir.initial.buffer.size is deprecated. Instead, use hbase.server.allocator.buffer.size 2022-03-24 01:43:39,664 INFO [main] Configuration.deprecation: hbase.ipc.server.reservoir.initial.max is deprecated. Instead, use hbase.server.allocator.max.buffer.count 2022-03-24 01:43:41,722 INFO [main] ipc.NettyRpcServer: Bind to /172.25.0.2:16000 2022-03-24 01:43:52,762 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2022-03-24 01:43:52,772 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2022-03-24 01:43:53,061 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=master:16000 connecting to ZooKeeper ensemble=C1hb-zk:11181 2022-03-24 01:43:53,193 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT 2022-03-24 01:43:53,194 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=C1HM1 2022-03-24 01:43:53,195 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_271 2022-03-24 01:43:53,196 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2022-03-24 01:43:53,196 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/home/hbuser/fav-jre-inst/jre 2022-03-24 01:43:53,197 INFO [main] zookeeper.ZooKeeper: /hbase-2.4.8/bin/../lib/spymemcached-2.12.2.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/stax2-api-3.1.4.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/woodstox-core-5.0.3.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/xmlenc-0.52.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/zookeeper-3.5.7.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/zookeeper-jute-3.5.7.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.30.jar:/home/hbuser/evaluation/hbase-2.4.8/bin/../lib/client-facing-thirdparty/slf4j-log4j12-1.7.30.jar:/home/hbuser/Phosphor-0.0.5-SNAPSHOT.jar 2022-03-24 01:43:53,198 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2022-03-24 01:43:53,198 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2022-03-24 01:43:53,199 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2022-03-24 01:43:53,199 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2022-03-24 01:43:53,200 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2022-03-24 01:43:53,201 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.el7.x86_64 2022-03-24 01:43:53,201 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=root 2022-03-24 01:43:53,202 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/root 2022-03-24 01:43:53,202 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/home/hbuser/evaluation/hbase-2.4.8 2022-03-24 01:43:53,203 INFO [main] zookeeper.ZooKeeper: Client environment:os.memory.free=1518MB 2022-03-24 01:43:53,203 INFO [main] zookeeper.ZooKeeper: Client environment:os.memory.max=30688MB 2022-03-24 01:43:53,204 INFO [main] zookeeper.ZooKeeper: Client environment:os.memory.total=2004MB 2022-03-24 01:43:53,242 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=C1hb-zk:11181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@63398d52 2022-03-24 01:43:53,321 INFO [main] common.X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2022-03-24 01:43:53,388 INFO [main] zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes 2022-03-24 01:43:53,502 INFO [main] zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled= 2022-03-24 01:43:53,608 INFO [main-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Opening socket connection to server C1hb-zk/172.25.0.8:11181. Will not attempt to authenticate using SASL (unknown error) 2022-03-24 01:43:53,618 INFO [main-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Socket connection established, initiating session, client: /172.25.0.2:52020, server: C1hb-zk/172.25.0.8:11181 2022-03-24 01:43:53,694 INFO [main-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Session establishment complete on server C1hb-zk/172.25.0.8:11181, sessionid = 0x1013caeb566e675, negotiated timeout = 40000 2022-03-24 01:43:54,610 INFO [main] util.log: Logging initialized @45646ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2022-03-24 01:43:56,489 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2022-03-24 01:43:56,498 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2022-03-24 01:43:56,508 INFO [main] http.HttpServer: Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2022-03-24 01:43:56,537 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2022-03-24 01:43:56,538 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2022-03-24 01:43:56,539 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2022-03-24 01:43:56,615 INFO [main] http.HttpServer: ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2022-03-24 01:43:57,351 INFO [main] http.HttpServer: Jetty bound to port 16010 2022-03-24 01:43:57,371 INFO [main] server.Server: jetty-9.4.41.v20210516; built: 2021-05-16T23:56:28.993Z; git: 98607f93c7833e7dc59489b13f3cb0a114fb9f4c; jvm 1.8.0_271-b09 2022-03-24 01:43:57,726 INFO [main] http.SecurityHeadersFilter: Added security headers filter 2022-03-24 01:43:57,757 INFO [main] handler.ContextHandler: Started o.a.h.t.o.e.j.s.ServletContextHandler@51878fae{logs,/logs,file:///home/hbuser/evaluation/hbase-2.4.8/logs/,AVAILABLE} 2022-03-24 01:43:57,758 INFO [main] http.SecurityHeadersFilter: Added security headers filter 2022-03-24 01:43:57,759 INFO [main] handler.ContextHandler: Started o.a.h.t.o.e.j.s.ServletContextHandler@615b8b23{static,/static,file:///home/hbuser/evaluation/hbase-2.4.8/hbase-webapps/static/,AVAILABLE} 2022-03-24 01:43:58,520 INFO [main] webapp.StandardDescriptorProcessor: NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2022-03-24 01:43:58,662 INFO [main] server.session: DefaultSessionIdManager workerName=node0 2022-03-24 01:43:58,663 INFO [main] server.session: No SessionScavenger set, using defaults 2022-03-24 01:43:58,685 INFO [main] server.session: node0 Scavenging every 600000ms 2022-03-24 01:43:58,742 INFO [main] http.SecurityHeadersFilter: Added security headers filter 2022-03-24 01:43:59,387 INFO [main] handler.ContextHandler: Started o.a.h.t.o.e.j.w.WebAppContext@50330998{master,/,file:///home/hbuser/evaluation/hbase-2.4.8/hbase-webapps/master/,AVAILABLE}{file:/home/hbuser/evaluation/hbase-2.4.8/hbase-webapps/master} 2022-03-24 01:43:59,502 INFO [main] server.AbstractConnector: Started ServerConnector@1acb4a84{HTTP/1.1, (http/1.1)}{0.0.0.0:16010} 2022-03-24 01:43:59,503 INFO [main] server.Server: Started @50539ms 2022-03-24 01:43:59,578 INFO [main] master.HMaster: hbase.rootdir=hdfs://C1hb-hdfs:9000/hbase, hbase.cluster.distributed=true 2022-03-24 01:43:59,902 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Adding backup master ZNode /hbase/backup-masters/c1hm1,16000,1648057399830 2022-03-24 01:44:00,745 INFO [master/C1HM1:16000:becomeActiveMaster] master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/c1hm1,16000,1648057399830 from backup master directory 2022-03-24 01:44:00,814 INFO [master/C1HM1:16000:becomeActiveMaster] master.ActiveMasterManager: Registered as active master=c1hm1,16000,1648057399830 2022-03-24 01:44:00,872 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 5523, initial count 0 2022-03-24 01:44:00,893 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 6137, initial count 0 2022-03-24 01:44:04,879 INFO [master/C1HM1:16000:becomeActiveMaster] util.FSUtils: Created version file at hdfs://C1hb-hdfs:9000/hbase with version=8 2022-03-24 01:44:05,663 INFO [master/C1HM1:16000:becomeActiveMaster] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2022-03-24 01:44:06,677 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ZooKeeper: Initiating client connection, connectString=C1hb-zk:11181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$98/2115478269@0 2022-03-24 01:44:06,679 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes 2022-03-24 01:44:06,680 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled= 2022-03-24 01:44:06,682 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Opening socket connection to server C1hb-zk/172.25.0.8:11181. Will not attempt to authenticate using SASL (unknown error) 2022-03-24 01:44:06,684 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Socket connection established, initiating session, client: /172.25.0.2:52070, server: C1hb-zk/172.25.0.8:11181 2022-03-24 01:44:06,689 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Session establishment complete on server C1hb-zk/172.25.0.8:11181, sessionid = 0x1013caeb566e687, negotiated timeout = 40000 2022-03-24 01:44:07,354 INFO [master/C1HM1:16000:becomeActiveMaster] region.MasterRegion: Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2022-03-24 01:44:07,371 INFO [master/C1HM1:16000:becomeActiveMaster] region.MasterRegionFlusherAndCompactor: Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2022-03-24 01:44:07,725 INFO [master/C1HM1:16000:becomeActiveMaster] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2022-03-24 01:44:08,179 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.HRegion: Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://C1hb-hdfs:9000/hbase/MasterData/data/master/store-tmp 2022-03-24 01:44:08,483 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.HRegion: Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2022-03-24 01:44:08,484 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.HRegion: Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2022-03-24 01:44:08,856 INFO [master/C1HM1:16000:becomeActiveMaster] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=c1hm1%2C16000%2C1648057399830, suffix=, logDir=hdfs://C1hb-hdfs:9000/hbase/MasterData/WALs/c1hm1,16000,1648057399830, archiveDir=hdfs://C1hb-hdfs:9000/hbase/MasterData/oldWALs, maxLogs=10 2022-03-24 01:44:10,517 INFO [master/C1HM1:16000:becomeActiveMaster] wal.AbstractFSWAL: New WAL /hbase/MasterData/WALs/c1hm1,16000,1648057399830/c1hm1%2C16000%2C1648057399830.1648057449042 2022-03-24 01:44:11,370 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore: Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2022-03-24 01:44:11,946 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration: size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2022-03-24 01:44:12,116 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore: Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2022-03-24 01:44:12,387 INFO [master/C1HM1:16000:becomeActiveMaster] regionserver.HRegion: Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11622624960, jitterRate=0.0824413001537323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2022-03-24 01:44:12,409 INFO [master/C1HM1:16000:becomeActiveMaster] region.MasterRegionFlusherAndCompactor: Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2022-03-24 01:44:12,776 INFO [master/C1HM1:16000:becomeActiveMaster] region.RegionProcedureStore: Starting the Region Procedure Store, number threads=16 2022-03-24 01:44:12,776 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.ProcedureExecutor: Starting 16 core workers (bigger of cpus/4 or 16) with max (burst) worker count=160 2022-03-24 01:44:12,798 INFO [master/C1HM1:16000:becomeActiveMaster] region.RegionProcedureStore: Starting Region Procedure Store lease recovery... 2022-03-24 01:44:12,810 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.ProcedureExecutor: Recovered RegionProcedureStore lease in 4 msec 2022-03-24 01:44:13,474 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.ProcedureExecutor: Loaded RegionProcedureStore in 663 msec 2022-03-24 01:44:13,474 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.RemoteProcedureDispatcher: Instantiated, coreThreads=128 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2022-03-24 01:44:14,154 INFO [master/C1HM1:16000:becomeActiveMaster] master.RegionServerTracker: Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2022-03-24 01:44:14,338 INFO [master/C1HM1:16000:becomeActiveMaster] balancer.BaseLoadBalancer: slop=0.001, systemTablesOnMaster=false 2022-03-24 01:44:14,381 INFO [master/C1HM1:16000:becomeActiveMaster] balancer.StochasticLoadBalancer: Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2022-03-24 01:44:14,467 INFO [master/C1HM1:16000:becomeActiveMaster] normalizer.RegionNormalizerWorker: Normalizer rate limit set to unlimited 2022-03-24 01:44:14,795 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Active/primary master=c1hm1,16000,1648057399830, sessionid=0x1013caeb566e675, setting cluster-up flag (Was=false) 2022-03-24 01:44:15,216 WARN [master/C1HM1:16000:becomeActiveMaster] snapshot.SnapshotManager: Couldn't delete working snapshot directory: hdfs://C1hb-hdfs:9000/hbase/.hbase-snapshot/.tmp 2022-03-24 01:44:18,045 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.TimeoutExecutorThread: ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1648057488045 2022-03-24 01:44:18,068 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.DirScanPool: Cleaner pool size is 16 2022-03-24 01:44:18,079 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2022-03-24 01:44:18,083 INFO [master/C1HM1:16000:becomeActiveMaster] zookeeper.RecoverableZooKeeper: Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=C1hb-zk:11181 2022-03-24 01:44:18,084 INFO [master/C1HM1:16000:becomeActiveMaster] zookeeper.ZooKeeper: Initiating client connection, connectString=C1hb-zk:11181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@51c63c5a 2022-03-24 01:44:18,085 INFO [master/C1HM1:16000:becomeActiveMaster] zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes 2022-03-24 01:44:18,086 INFO [master/C1HM1:16000:becomeActiveMaster] zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled= 2022-03-24 01:44:18,087 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2022-03-24 01:44:18,087 INFO [master/C1HM1:16000:becomeActiveMaster-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Opening socket connection to server C1hb-zk/172.25.0.8:11181. Will not attempt to authenticate using SASL (unknown error) 2022-03-24 01:44:18,089 INFO [master/C1HM1:16000:becomeActiveMaster-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Socket connection established, initiating session, client: /172.25.0.2:52108, server: C1hb-zk/172.25.0.8:11181 2022-03-24 01:44:18,092 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2022-03-24 01:44:18,094 INFO [master/C1HM1:16000:becomeActiveMaster-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Session establishment complete on server C1hb-zk/172.25.0.8:11181, sessionid = 0x1013caeb566e694, negotiated timeout = 40000 2022-03-24 01:44:18,096 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2022-03-24 01:44:18,097 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.LogCleaner: Creating 2 old WALs cleaner threads 2022-03-24 01:44:18,102 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:18,127 INFO [PEWorker-1] procedure.InitMetaProcedure: BOOTSTRAP: creating hbase:meta region 2022-03-24 01:44:18,127 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2022-03-24 01:44:18,129 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2022-03-24 01:44:18,155 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2022-03-24 01:44:18,159 INFO [master/C1HM1:16000:becomeActiveMaster] cleaner.CleanerChore: Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2022-03-24 01:44:18,171 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:18,172 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2022-03-24 01:44:18,181 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:18,182 INFO [PEWorker-1] util.FSTableDescriptors: table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2022-03-24 01:44:18,182 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:18,527 INFO [PEWorker-1] util.FSTableDescriptors: Updated hbase:meta table descriptor to hdfs://C1hb-hdfs:9000/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2022-03-24 01:44:18,529 INFO [PEWorker-1] regionserver.HRegion: ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://C1hb-hdfs:9000/hbase 2022-03-24 01:44:18,594 INFO [StoreOpener-1588230740-1] regionserver.HStore: Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2022-03-24 01:44:18,612 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2022-03-24 01:44:18,618 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2022-03-24 01:44:18,627 INFO [StoreOpener-1588230740-1] regionserver.HStore: Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2022-03-24 01:44:18,643 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2022-03-24 01:44:18,649 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2022-03-24 01:44:18,650 INFO [StoreOpener-1588230740-1] regionserver.HStore: Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2022-03-24 01:44:18,666 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2022-03-24 01:44:18,671 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2022-03-24 01:44:18,738 INFO [PEWorker-1] regionserver.HRegion: Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11247617120, jitterRate=0.04751597344875336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2022-03-24 01:44:18,740 INFO [PEWorker-1] regionserver.HRegion: Closing region hbase:meta,,1.1588230740 2022-03-24 01:44:18,749 INFO [PEWorker-1] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2022-03-24 01:44:18,801 INFO [PEWorker-1] procedure.InitMetaProcedure: Going to assign meta 2022-03-24 01:44:18,908 INFO [PEWorker-1] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2022-03-24 01:44:19,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler: Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2022-03-24 01:44:19,059 INFO [PEWorker-2] assignment.TransitRegionStateProcedure: Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2022-03-24 01:44:19,211 WARN [C1HM1:16000] assignment.AssignmentManager: No servers available; cannot place 1 unassigned regions. 2022-03-24 01:44:20,213 WARN [C1HM1:16000] assignment.AssignmentManager: No servers available; cannot place 1 unassigned regions. 2022-03-24 01:44:20,582 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16000] master.ServerManager: Registering regionserver=c1rs2,16020,1648057407638 2022-03-24 01:44:20,583 INFO [RpcServer.default.FPBQ.Fifo.handler=27,queue=0,port=16000] master.ServerManager: Registering regionserver=c1rs1,16020,1648057404041 2022-03-24 01:44:20,584 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.ServerManager: Registering regionserver=c1rs3,16020,1648057410351 2022-03-24 01:44:20,907 INFO [PEWorker-3] zookeeper.MetaTableLocator: Setting hbase:meta replicaId=0 location in ZooKeeper as c1rs2,16020,1648057407638, state=OPENING 2022-03-24 01:44:21,117 INFO [PEWorker-3] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=c1rs2,16020,1648057407638}] 2022-03-24 01:44:21,255 INFO [RegionServerTracker-0] master.RegionServerTracker: RegionServer ephemeral node created, adding [c1rs3,16020,1648057410351] 2022-03-24 01:44:21,660 INFO [RegionServerTracker-0] master.RegionServerTracker: RegionServer ephemeral node created, adding [c1rs2,16020,1648057407638] 2022-03-24 01:44:21,685 INFO [RegionServerTracker-0] master.RegionServerTracker: RegionServer ephemeral node created, adding [c1rs1,16020,1648057404041] 2022-03-24 01:44:23,919 WARN [RSProcedureDispatcher-pool-0] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=0, can wait up to 60000ms 2022-03-24 01:44:24,033 WARN [RSProcedureDispatcher-pool-1] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=1, can wait up to 59885ms 2022-03-24 01:44:24,149 WARN [RSProcedureDispatcher-pool-2] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=2, can wait up to 59769ms 2022-03-24 01:44:24,264 WARN [RSProcedureDispatcher-pool-3] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=3, can wait up to 59654ms 2022-03-24 01:44:24,378 WARN [RSProcedureDispatcher-pool-4] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=4, can wait up to 59540ms 2022-03-24 01:44:24,493 WARN [RSProcedureDispatcher-pool-5] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=5, can wait up to 59425ms 2022-03-24 01:44:24,609 WARN [RSProcedureDispatcher-pool-6] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=6, can wait up to 59309ms 2022-03-24 01:44:24,726 WARN [RSProcedureDispatcher-pool-7] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=7, can wait up to 59192ms 2022-03-24 01:44:24,840 WARN [RSProcedureDispatcher-pool-8] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=8, can wait up to 59078ms 2022-03-24 01:44:24,953 WARN [RSProcedureDispatcher-pool-9] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=9, can wait up to 58965ms 2022-03-24 01:44:25,069 WARN [RSProcedureDispatcher-pool-10] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=10, can wait up to 58849ms 2022-03-24 01:44:25,182 WARN [RSProcedureDispatcher-pool-11] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=11, can wait up to 58736ms 2022-03-24 01:44:25,295 WARN [RSProcedureDispatcher-pool-12] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=12, can wait up to 58623ms 2022-03-24 01:44:25,410 WARN [RSProcedureDispatcher-pool-13] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=13, can wait up to 58508ms 2022-03-24 01:44:25,557 WARN [RSProcedureDispatcher-pool-14] procedure.RSProcedureDispatcher: Waiting a little before retrying c1rs2,16020,1648057407638, try=14, can wait up to 58361ms 2022-03-24 01:44:34,335 INFO [PEWorker-5] zookeeper.MetaTableLocator: Setting hbase:meta replicaId=0 location in ZooKeeper as c1rs2,16020,1648057407638, state=OPEN 2022-03-24 01:44:34,497 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished subprocedure pid=3, resume processing ppid=2 2022-03-24 01:44:34,498 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=c1rs2,16020,1648057407638 in 13.3600 sec 2022-03-24 01:44:34,525 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished subprocedure pid=2, resume processing ppid=1 2022-03-24 01:44:34,527 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 15.5990 sec 2022-03-24 01:44:34,559 INFO [PEWorker-7] procedure2.ProcedureExecutor: Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 17.7580 sec 2022-03-24 01:44:34,560 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1648057440686, completionTime=-1 2022-03-24 01:44:34,561 INFO [master/C1HM1:16000:becomeActiveMaster] master.ServerManager: Waiting on regionserver count=3; waited=0ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=0ms 2022-03-24 01:44:36,066 INFO [master/C1HM1:16000:becomeActiveMaster] master.ServerManager: Waiting on regionserver count=3; waited=1505ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=1505ms 2022-03-24 01:44:37,571 INFO [master/C1HM1:16000:becomeActiveMaster] master.ServerManager: Waiting on regionserver count=3; waited=3010ms, expecting min=1 server(s), max=NO_LIMIT server(s), timeout=4500ms, lastChange=3010ms 2022-03-24 01:44:39,076 INFO [master/C1HM1:16000:becomeActiveMaster] master.ServerManager: Finished waiting on RegionServer count=3; waited=4515ms, expected min=1 server(s), max=NO_LIMIT server(s), master is running 2022-03-24 01:44:40,732 INFO [master/C1HM1:16000:becomeActiveMaster] assignment.AssignmentManager: Number of RegionServers=3 2022-03-24 01:44:40,734 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.TimeoutExecutorThread: ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1648057540734 2022-03-24 01:44:40,735 INFO [master/C1HM1:16000:becomeActiveMaster] procedure2.TimeoutExecutorThread: ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1648057600735 2022-03-24 01:44:40,736 INFO [master/C1HM1:16000:becomeActiveMaster] assignment.AssignmentManager: Joined the cluster in 1.6580 sec 2022-03-24 01:44:41,106 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=c1hm1,16000,1648057399830-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:41,107 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=c1hm1,16000,1648057399830-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:41,108 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=c1hm1,16000,1648057399830-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:41,135 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=CatalogJanitor-C1HM1:16000, period=300000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:41,138 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2022-03-24 01:44:41,350 INFO [master/C1HM1:16000:becomeActiveMaster] master.TableNamespaceManager: Namespace table not found. Creating... 2022-03-24 01:44:41,370 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2022-03-24 01:44:41,515 INFO [PEWorker-8] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2022-03-24 01:44:41,533 INFO [PEWorker-8] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2022-03-24 01:44:41,896 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion: creating {ENCODED => d9896fe2aeffc6cbe2f1c821a55f3fae, NAME => 'hbase:namespace,,1648057481362.d9896fe2aeffc6cbe2f1c821a55f3fae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://C1hb-hdfs:9000/hbase/.tmp 2022-03-24 01:44:41,937 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion: Closing region hbase:namespace,,1648057481362.d9896fe2aeffc6cbe2f1c821a55f3fae. 2022-03-24 01:44:41,938 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion: Closed hbase:namespace,,1648057481362.d9896fe2aeffc6cbe2f1c821a55f3fae. 2022-03-24 01:44:41,960 INFO [PEWorker-8] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2022-03-24 01:44:42,808 INFO [PEWorker-8] hbase.MetaTableAccessor: Added 1 regions to meta. 2022-03-24 01:44:42,816 INFO [PEWorker-8] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2022-03-24 01:44:42,965 INFO [PEWorker-8] hbase.MetaTableAccessor: Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2022-03-24 01:44:43,024 INFO [PEWorker-8] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9896fe2aeffc6cbe2f1c821a55f3fae, ASSIGN}] 2022-03-24 01:44:43,033 INFO [PEWorker-9] procedure.MasterProcedureScheduler: Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9896fe2aeffc6cbe2f1c821a55f3fae, ASSIGN 2022-03-24 01:44:43,040 INFO [PEWorker-9] assignment.TransitRegionStateProcedure: Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d9896fe2aeffc6cbe2f1c821a55f3fae, ASSIGN; state=OFFLINE, location=c1rs3,16020,1648057410351; forceNewPlan=false, retain=false 2022-03-24 01:44:43,223 INFO [C1HM1:16000] balancer.BaseLoadBalancer: Reassigned 1 regions. 1 retained the pre-restart assignment. 2022-03-24 01:44:43,225 INFO [PEWorker-11] assignment.RegionStateStore: pid=5 updating hbase:meta row=d9896fe2aeffc6cbe2f1c821a55f3fae, regionState=OPENING, regionLocation=c1rs3,16020,1648057410351 2022-03-24 01:44:43,354 INFO [PEWorker-11] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d9896fe2aeffc6cbe2f1c821a55f3fae, server=c1rs3,16020,1648057410351}] 2022-03-24 01:44:49,621 INFO [PEWorker-12] assignment.RegionStateStore: pid=5 updating hbase:meta row=d9896fe2aeffc6cbe2f1c821a55f3fae, regionState=OPEN, openSeqNum=2, regionLocation=c1rs3,16020,1648057410351 2022-03-24 01:44:49,657 INFO [PEWorker-12] procedure2.ProcedureExecutor: Finished subprocedure pid=6, resume processing ppid=5 2022-03-24 01:44:49,658 INFO [PEWorker-12] procedure2.ProcedureExecutor: Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d9896fe2aeffc6cbe2f1c821a55f3fae, server=c1rs3,16020,1648057410351 in 6.2900 sec 2022-03-24 01:44:49,669 INFO [PEWorker-13] procedure2.ProcedureExecutor: Finished subprocedure pid=5, resume processing ppid=4 2022-03-24 01:44:49,671 INFO [PEWorker-13] procedure2.ProcedureExecutor: Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d9896fe2aeffc6cbe2f1c821a55f3fae, ASSIGN in 6.6330 sec 2022-03-24 01:44:49,674 INFO [PEWorker-14] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2022-03-24 01:44:49,693 INFO [PEWorker-14] hbase.MetaTableAccessor: Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2022-03-24 01:44:49,707 INFO [PEWorker-14] procedure.CreateTableProcedure: pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2022-03-24 01:44:49,720 INFO [PEWorker-14] procedure2.ProcedureExecutor: Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 8.3290 sec 2022-03-24 01:44:52,138 INFO [PEWorker-15] procedure2.ProcedureExecutor: Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 924 msec 2022-03-24 01:44:52,327 INFO [PEWorker-16] procedure2.ProcedureExecutor: Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 111 msec 2022-03-24 01:44:52,912 INFO [master/C1HM1:16000:becomeActiveMaster] master.HMaster: Master has completed initialization 52.097sec 2022-03-24 01:44:52,939 INFO [master/C1HM1:16000:becomeActiveMaster] quotas.MasterQuotaManager: Quota support disabled 2022-03-24 01:44:52,972 INFO [master/C1HM1:16000:becomeActiveMaster] slowlog.SlowLogMasterService: Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2022-03-24 01:44:52,973 INFO [master/C1HM1:16000:becomeActiveMaster] zookeeper.ZKWatcher: not a secure deployment, proceeding 2022-03-24 01:44:52,986 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=c1hm1,16000,1648057399830-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2022-03-24 01:44:52,994 INFO [master/C1HM1:16000:becomeActiveMaster] hbase.ChoreService: Chore ScheduledChore name=c1hm1,16000,1648057399830-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2022-03-24 01:44:56,160 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.HMaster: Client=hbuser//172.25.0.1 create 'FAVMyInfo', {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2022-03-24 01:44:56,173 INFO [PEWorker-1] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_PRE_OPERATION 2022-03-24 01:44:56,188 INFO [PEWorker-1] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2022-03-24 01:44:56,246 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.MasterRpcServices: Client=hbuser//172.25.0.1 procedure request for creating table: namespace: "default" qualifier: "FAVMyInfo" procId is: 9 2022-03-24 01:44:56,292 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: creating {ENCODED => 170c0280db20141316f63ba81e389ed6, NAME => 'FAVMyInfo,,1648057496087.170c0280db20141316f63ba81e389ed6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='FAVMyInfo', {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://C1hb-hdfs:9000/hbase/.tmp 2022-03-24 01:44:56,329 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: Closing region FAVMyInfo,,1648057496087.170c0280db20141316f63ba81e389ed6. 2022-03-24 01:44:56,330 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: Closed FAVMyInfo,,1648057496087.170c0280db20141316f63ba81e389ed6. 2022-03-24 01:44:56,353 INFO [PEWorker-1] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_ADD_TO_META 2022-03-24 01:44:56,382 INFO [PEWorker-1] hbase.MetaTableAccessor: Added 1 regions to meta. 2022-03-24 01:44:56,389 INFO [PEWorker-1] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_ASSIGN_REGIONS 2022-03-24 01:44:56,408 INFO [PEWorker-1] hbase.MetaTableAccessor: Updated tableName=FAVMyInfo, state=ENABLING in hbase:meta 2022-03-24 01:44:56,431 INFO [PEWorker-1] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, ASSIGN}] 2022-03-24 01:44:56,611 INFO [AsyncFSWAL-0-hdfs://C1hb-hdfs:9000/hbase/MasterData] wal.AbstractFSWAL: Slow sync cost: 176 ms, current pipeline: [DatanodeInfoWithStorage[172.25.0.7:9866,DS-c880b2eb-3656-4484-955e-8fa2177db65a,DISK]] 2022-03-24 01:44:56,614 INFO [PEWorker-2] procedure.MasterProcedureScheduler: Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, ASSIGN 2022-03-24 01:44:56,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure: Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, ASSIGN; state=OFFLINE, location=c1rs1,16020,1648057404041; forceNewPlan=false, retain=false 2022-03-24 01:44:56,773 INFO [C1HM1:16000] balancer.BaseLoadBalancer: Reassigned 1 regions. 1 retained the pre-restart assignment. 2022-03-24 01:44:56,775 INFO [PEWorker-4] assignment.RegionStateStore: pid=10 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPENING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:44:56,797 INFO [PEWorker-4] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:45:03,136 INFO [PEWorker-5] assignment.RegionStateStore: pid=10 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPEN, openSeqNum=2, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:45:03,167 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished subprocedure pid=11, resume processing ppid=10 2022-03-24 01:45:03,172 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 6.3600 sec 2022-03-24 01:45:03,179 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished subprocedure pid=10, resume processing ppid=9 2022-03-24 01:45:03,181 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, ASSIGN in 6.7380 sec 2022-03-24 01:45:03,184 INFO [PEWorker-7] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2022-03-24 01:45:03,205 INFO [PEWorker-7] hbase.MetaTableAccessor: Updated tableName=FAVMyInfo, state=ENABLED in hbase:meta 2022-03-24 01:45:03,233 INFO [PEWorker-7] procedure.CreateTableProcedure: pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=FAVMyInfo execute state=CREATE_TABLE_POST_OPERATION 2022-03-24 01:45:03,242 INFO [PEWorker-7] procedure2.ProcedureExecutor: Finished pid=9, state=SUCCESS; CreateTableProcedure table=FAVMyInfo in 7.0720 sec 2022-03-24 01:45:33,979 INFO [RegionServerTracker-0] master.RegionServerTracker: RegionServer ephemeral node deleted, processing expiration [c1rs2,16020,1648057407638] 2022-03-24 01:45:33,985 INFO [RegionServerTracker-0] master.ServerManager: Processing expiration of c1rs2,16020,1648057407638 on c1hm1,16000,1648057399830 2022-03-24 01:45:34,103 INFO [RegionServerTracker-0] assignment.AssignmentManager: Scheduled ServerCrashProcedure pid=12 for c1rs2,16020,1648057407638 (carryingMeta=true) c1rs2,16020,1648057407638/CRASHED/regionCount=1/lock=java.util.concurrent.locks.ReentrantReadWriteLock@4b40eb6[Write locks = 1, Read locks = 0], oldState=ONLINE. 2022-03-24 01:45:34,131 INFO [PEWorker-8] procedure.ServerCrashProcedure: Start pid=12, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure c1rs2,16020,1648057407638, splitWal=true, meta=true 2022-03-24 01:45:34,134 INFO [PEWorker-8] procedure.ServerCrashProcedure: Splitting WALs pid=12, state=RUNNABLE:SERVER_CRASH_SPLIT_META_LOGS, locked=true; ServerCrashProcedure c1rs2,16020,1648057407638, splitWal=true, meta=true, isMeta: true 2022-03-24 01:45:34,152 INFO [PEWorker-8] master.SplitWALManager: c1rs2,16020,1648057407638 WAL count=1, meta=true 2022-03-24 01:45:34,186 INFO [PEWorker-8] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure c1rs2%2C16020%2C1648057407638.meta.1648057468091.meta}] 2022-03-24 01:45:34,301 INFO [PEWorker-8] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; SplitWALRemoteProcedure c1rs2%2C16020%2C1648057407638.meta.1648057468091.meta, worker=c1rs1,16020,1648057404041}] 2022-03-24 01:45:39,738 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ZooKeeper: Session: 0x1013caeb566e687 closed 2022-03-24 01:45:39,738 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-EventThread] zookeeper.ClientCnxn: EventThread shut down for session: 0x1013caeb566e687 2022-03-24 01:45:40,520 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] wal.WALSplitUtil: Moved hdfs://C1hb-hdfs:9000/hbase/WALs/c1rs2,16020,1648057407638-splitting/c1rs2%2C16020%2C1648057407638.meta.1648057468091.meta to hdfs://C1hb-hdfs:9000/hbase/oldWALs 2022-03-24 01:45:40,534 INFO [PEWorker-11] procedure2.ProcedureExecutor: Finished subprocedure pid=14, resume processing ppid=13 2022-03-24 01:45:40,542 INFO [PEWorker-11] procedure2.ProcedureExecutor: Finished pid=14, ppid=13, state=SUCCESS; SplitWALRemoteProcedure c1rs2%2C16020%2C1648057407638.meta.1648057468091.meta, worker=c1rs1,16020,1648057404041 in 6.2240 sec 2022-03-24 01:45:40,564 INFO [PEWorker-12] procedure2.ProcedureExecutor: Finished subprocedure pid=13, resume processing ppid=12 2022-03-24 01:45:40,565 INFO [PEWorker-12] procedure2.ProcedureExecutor: Finished pid=13, ppid=12, state=SUCCESS; SplitWALProcedure c1rs2%2C16020%2C1648057407638.meta.1648057468091.meta, worker=c1rs1,16020,1648057404041 in 6.3760 sec 2022-03-24 01:45:40,577 INFO [PEWorker-13] master.SplitLogManager: hdfs://C1hb-hdfs:9000/hbase/WALs/c1rs2,16020,1648057407638-splitting dir is empty, no logs to split. 2022-03-24 01:45:40,578 INFO [PEWorker-13] master.SplitWALManager: c1rs2,16020,1648057407638 WAL count=0, meta=true 2022-03-24 01:45:40,584 INFO [PEWorker-13] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2022-03-24 01:45:40,589 INFO [PEWorker-13] procedure.MasterProcedureScheduler: Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2022-03-24 01:45:40,594 INFO [PEWorker-13] assignment.TransitRegionStateProcedure: Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OPEN, location=null; forceNewPlan=true, retain=false 2022-03-24 01:45:40,747 INFO [PEWorker-15] zookeeper.MetaTableLocator: Setting hbase:meta replicaId=0 location in ZooKeeper as c1rs3,16020,1648057410351, state=OPENING 2022-03-24 01:45:40,756 INFO [PEWorker-15] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; OpenRegionProcedure 1588230740, server=c1rs3,16020,1648057410351}] 2022-03-24 01:45:44,664 INFO [PEWorker-1] zookeeper.MetaTableLocator: Setting hbase:meta replicaId=0 location in ZooKeeper as c1rs3,16020,1648057410351, state=OPEN 2022-03-24 01:45:44,685 INFO [PEWorker-1] procedure2.ProcedureExecutor: Finished subprocedure pid=16, resume processing ppid=15 2022-03-24 01:45:44,686 INFO [PEWorker-1] procedure2.ProcedureExecutor: Finished pid=16, ppid=15, state=SUCCESS; OpenRegionProcedure 1588230740, server=c1rs3,16020,1648057410351 in 3.9160 sec 2022-03-24 01:45:44,694 INFO [PEWorker-2] procedure2.ProcedureExecutor: Finished subprocedure pid=15, resume processing ppid=12 2022-03-24 01:45:44,695 INFO [PEWorker-2] procedure2.ProcedureExecutor: Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 4.1010 sec 2022-03-24 01:45:44,702 INFO [PEWorker-3] procedure.ServerCrashProcedure: c1rs2,16020,1648057407638 had 1 regions 2022-03-24 01:45:44,708 INFO [PEWorker-3] procedure.ServerCrashProcedure: Splitting WALs pid=12, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure c1rs2,16020,1648057407638, splitWal=true, meta=true, isMeta: false 2022-03-24 01:45:44,721 INFO [PEWorker-3] master.SplitWALManager: c1rs2,16020,1648057407638 WAL count=1, meta=false 2022-03-24 01:45:44,723 INFO [PEWorker-3] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=17, ppid=12, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure c1rs2%2C16020%2C1648057407638.1648057468921}] 2022-03-24 01:45:44,733 INFO [PEWorker-3] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=18, ppid=17, state=RUNNABLE; SplitWALRemoteProcedure c1rs2%2C16020%2C1648057407638.1648057468921, worker=c1rs1,16020,1648057404041}] 2022-03-24 01:45:49,007 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] wal.WALSplitUtil: Moved hdfs://C1hb-hdfs:9000/hbase/WALs/c1rs2,16020,1648057407638-splitting/c1rs2%2C16020%2C1648057407638.1648057468921 to hdfs://C1hb-hdfs:9000/hbase/oldWALs 2022-03-24 01:45:49,021 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished subprocedure pid=18, resume processing ppid=17 2022-03-24 01:45:49,022 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished pid=18, ppid=17, state=SUCCESS; SplitWALRemoteProcedure c1rs2%2C16020%2C1648057407638.1648057468921, worker=c1rs1,16020,1648057404041 in 4.2790 sec 2022-03-24 01:45:49,037 INFO [PEWorker-7] procedure2.ProcedureExecutor: Finished subprocedure pid=17, resume processing ppid=12 2022-03-24 01:45:49,039 INFO [PEWorker-7] procedure2.ProcedureExecutor: Finished pid=17, ppid=12, state=SUCCESS; SplitWALProcedure c1rs2%2C16020%2C1648057407638.1648057468921, worker=c1rs1,16020,1648057404041 in 4.3040 sec 2022-03-24 01:45:49,049 INFO [PEWorker-9] master.SplitLogManager: hdfs://C1hb-hdfs:9000/hbase/WALs/c1rs2,16020,1648057407638-splitting dir is empty, no logs to split. 2022-03-24 01:45:49,050 INFO [PEWorker-9] master.SplitWALManager: c1rs2,16020,1648057407638 WAL count=0, meta=false 2022-03-24 01:45:49,073 INFO [PEWorker-9] procedure.ServerCrashProcedure: removed crashed server c1rs2,16020,1648057407638 after splitting done 2022-03-24 01:45:49,089 INFO [PEWorker-9] procedure2.ProcedureExecutor: Finished pid=12, state=SUCCESS; ServerCrashProcedure c1rs2,16020,1648057407638, splitWal=true, meta=true in 15.0660 sec 2022-03-24 01:46:00,216 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.HMaster: Client=hbuser//172.25.0.1 modify table FAVMyInfo from 'FAVMyInfo', {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} to 'FAVMyInfo', {NAME => 'Office', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2022-03-24 01:46:00,450 INFO [PEWorker-8] util.FSTableDescriptors: Updated tableinfo=hdfs://C1hb-hdfs:9000/hbase/data/default/FAVMyInfo/.tabledesc/.tableinfo.0000000002 2022-03-24 01:46:00,521 INFO [PEWorker-8] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=FAVMyInfo}] 2022-03-24 01:46:00,760 INFO [PEWorker-10] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE}] 2022-03-24 01:46:00,765 INFO [PEWorker-11] procedure.MasterProcedureScheduler: Took xlock for pid=21, ppid=20, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE 2022-03-24 01:46:00,770 INFO [PEWorker-11] assignment.RegionStateStore: pid=21 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:10,914 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ZooKeeper: Initiating client connection, connectString=C1hb-zk:11181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$98/2115478269@0 2022-03-24 01:46:10,916 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes 2022-03-24 01:46:10,917 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1] zookeeper.ClientCnxn: zookeeper.request.timeout value is 0. feature enabled= 2022-03-24 01:46:10,920 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Opening socket connection to server C1hb-zk/172.25.0.8:11181. Will not attempt to authenticate using SASL (unknown error) 2022-03-24 01:46:10,922 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Socket connection established, initiating session, client: /172.25.0.2:52452, server: C1hb-zk/172.25.0.8:11181 2022-03-24 01:46:10,926 INFO [ReadOnlyZKClient-C1hb-zk:11181@0x229243a1-SendThread(C1hb-zk:11181)] zookeeper.ClientCnxn: Session establishment complete on server C1hb-zk/172.25.0.8:11181, sessionid = 0x1013caeb566e6a0, negotiated timeout = 40000 2022-03-24 01:46:10,991 INFO [PEWorker-11] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:46:13,819 INFO [PEWorker-14] assignment.RegionStateStore: pid=21 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSED 2022-03-24 01:46:13,849 INFO [PEWorker-14] procedure2.ProcedureExecutor: Finished subprocedure pid=22, resume processing ppid=21 2022-03-24 01:46:13,850 INFO [PEWorker-14] procedure2.ProcedureExecutor: Finished pid=22, ppid=21, state=SUCCESS; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 2.8480 sec 2022-03-24 01:46:13,853 INFO [PEWorker-13] assignment.TransitRegionStateProcedure: Starting pid=21, ppid=20, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE; state=CLOSED, location=c1rs1,16020,1648057404041; forceNewPlan=false, retain=true 2022-03-24 01:46:14,004 INFO [C1HM1:16000] balancer.BaseLoadBalancer: Reassigned 1 regions. 1 retained the pre-restart assignment. 2022-03-24 01:46:14,006 INFO [PEWorker-16] assignment.RegionStateStore: pid=21 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPENING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:14,114 INFO [PEWorker-16] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=23, ppid=21, state=RUNNABLE; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:46:14,538 INFO [PEWorker-1] assignment.RegionStateStore: pid=21 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPEN, openSeqNum=9, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:14,571 INFO [PEWorker-1] procedure2.ProcedureExecutor: Finished subprocedure pid=23, resume processing ppid=21 2022-03-24 01:46:14,572 INFO [PEWorker-1] procedure2.ProcedureExecutor: Finished pid=23, ppid=21, state=SUCCESS; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 447 msec 2022-03-24 01:46:14,581 INFO [PEWorker-2] procedure2.ProcedureExecutor: Finished subprocedure pid=21, resume processing ppid=20 2022-03-24 01:46:14,582 INFO [PEWorker-2] procedure2.ProcedureExecutor: Finished pid=21, ppid=20, state=SUCCESS; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE in 13.8110 sec 2022-03-24 01:46:14,608 INFO [PEWorker-4] procedure2.ProcedureExecutor: Finished subprocedure pid=20, resume processing ppid=19 2022-03-24 01:46:14,609 INFO [PEWorker-4] procedure2.ProcedureExecutor: Finished pid=20, ppid=19, state=SUCCESS; ReopenTableRegionsProcedure table=FAVMyInfo in 14.0970 sec 2022-03-24 01:46:14,620 INFO [PEWorker-3] procedure2.ProcedureExecutor: Finished pid=19, state=SUCCESS; ModifyTableProcedure table=FAVMyInfo in 14.3730 sec 2022-03-24 01:46:14,665 WARN [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] ipc.RpcServer: (responseTooSlow): {"call":"AddColumn(org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$AddColumnRequest)","starttimems":"1648057560195","responsesize":"33","method":"AddColumn","param":"TODO: class org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$AddColumnRequest","processingtimems":14465,"client":"172.25.0.1:36698","queuetimems":0,"class":"HMaster"} 2022-03-24 01:46:14,948 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.HMaster: Client=hbuser//172.25.0.1 modify table FAVMyInfo from 'FAVMyInfo', {NAME => 'Office', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} to 'FAVMyInfo', {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2022-03-24 01:46:15,069 INFO [PEWorker-5] util.FSTableDescriptors: Updated tableinfo=hdfs://C1hb-hdfs:9000/hbase/data/default/FAVMyInfo/.tabledesc/.tableinfo.0000000003 2022-03-24 01:46:15,081 INFO [PEWorker-5] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=FAVMyInfo}] 2022-03-24 01:46:15,094 INFO [PEWorker-6] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=26, ppid=25, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE}] 2022-03-24 01:46:15,100 INFO [PEWorker-7] procedure.MasterProcedureScheduler: Took xlock for pid=26, ppid=25, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE 2022-03-24 01:46:15,104 INFO [PEWorker-7] assignment.RegionStateStore: pid=26 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:15,128 INFO [PEWorker-7] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=27, ppid=26, state=RUNNABLE; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:46:15,881 INFO [PEWorker-8] assignment.RegionStateStore: pid=26 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSED 2022-03-24 01:46:15,911 INFO [PEWorker-8] procedure2.ProcedureExecutor: Finished subprocedure pid=27, resume processing ppid=26 2022-03-24 01:46:15,912 INFO [PEWorker-8] procedure2.ProcedureExecutor: Finished pid=27, ppid=26, state=SUCCESS; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 773 msec 2022-03-24 01:46:15,915 INFO [PEWorker-10] assignment.TransitRegionStateProcedure: Starting pid=26, ppid=25, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE; state=CLOSED, location=c1rs1,16020,1648057404041; forceNewPlan=false, retain=true 2022-03-24 01:46:16,066 INFO [C1HM1:16000] balancer.BaseLoadBalancer: Reassigned 1 regions. 1 retained the pre-restart assignment. 2022-03-24 01:46:16,068 INFO [PEWorker-12] assignment.RegionStateStore: pid=26 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPENING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:16,089 INFO [PEWorker-12] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=28, ppid=26, state=RUNNABLE; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:46:16,457 INFO [PEWorker-14] assignment.RegionStateStore: pid=26 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=OPEN, openSeqNum=17, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:16,488 INFO [PEWorker-14] procedure2.ProcedureExecutor: Finished subprocedure pid=28, resume processing ppid=26 2022-03-24 01:46:16,489 INFO [PEWorker-14] procedure2.ProcedureExecutor: Finished pid=28, ppid=26, state=SUCCESS; OpenRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 388 msec 2022-03-24 01:46:16,499 INFO [PEWorker-13] procedure2.ProcedureExecutor: Finished subprocedure pid=26, resume processing ppid=25 2022-03-24 01:46:16,501 INFO [PEWorker-13] procedure2.ProcedureExecutor: Finished pid=26, ppid=25, state=SUCCESS; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, REOPEN/MOVE in 1.3940 sec 2022-03-24 01:46:16,512 INFO [PEWorker-16] procedure2.ProcedureExecutor: Finished subprocedure pid=25, resume processing ppid=24 2022-03-24 01:46:16,513 INFO [PEWorker-16] procedure2.ProcedureExecutor: Finished pid=25, ppid=24, state=SUCCESS; ReopenTableRegionsProcedure table=FAVMyInfo in 1.4210 sec 2022-03-24 01:46:16,563 INFO [PEWorker-15] procedure2.ProcedureExecutor: Finished pid=24, state=SUCCESS; ModifyTableProcedure table=FAVMyInfo in 1.6070 sec 2022-03-24 01:46:17,496 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.HMaster: Client=hbuser//172.25.0.1 disable FAVMyInfo 2022-03-24 01:46:17,623 INFO [PEWorker-1] hbase.MetaTableAccessor: Updated tableName=FAVMyInfo, state=DISABLING in hbase:meta 2022-03-24 01:46:17,631 INFO [PEWorker-1] procedure.DisableTableProcedure: Set FAVMyInfo to state=DISABLING 2022-03-24 01:46:17,654 INFO [PEWorker-1] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, UNASSIGN}] 2022-03-24 01:46:17,659 INFO [PEWorker-2] procedure.MasterProcedureScheduler: Took xlock for pid=30, ppid=29, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, UNASSIGN 2022-03-24 01:46:17,664 INFO [PEWorker-2] assignment.RegionStateStore: pid=30 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSING, regionLocation=c1rs1,16020,1648057404041 2022-03-24 01:46:17,683 INFO [PEWorker-2] procedure2.ProcedureExecutor: Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041}] 2022-03-24 01:46:18,080 INFO [PEWorker-3] assignment.RegionStateStore: pid=30 updating hbase:meta row=170c0280db20141316f63ba81e389ed6, regionState=CLOSED 2022-03-24 01:46:18,108 INFO [PEWorker-3] procedure2.ProcedureExecutor: Finished subprocedure pid=31, resume processing ppid=30 2022-03-24 01:46:18,109 INFO [PEWorker-3] procedure2.ProcedureExecutor: Finished pid=31, ppid=30, state=SUCCESS; CloseRegionProcedure 170c0280db20141316f63ba81e389ed6, server=c1rs1,16020,1648057404041 in 414 msec 2022-03-24 01:46:18,119 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished subprocedure pid=30, resume processing ppid=29 2022-03-24 01:46:18,120 INFO [PEWorker-5] procedure2.ProcedureExecutor: Finished pid=30, ppid=29, state=SUCCESS; TransitRegionStateProcedure table=FAVMyInfo, region=170c0280db20141316f63ba81e389ed6, UNASSIGN in 454 msec 2022-03-24 01:46:18,137 INFO [PEWorker-6] hbase.MetaTableAccessor: Updated tableName=FAVMyInfo, state=DISABLED in hbase:meta 2022-03-24 01:46:18,145 INFO [PEWorker-6] procedure.DisableTableProcedure: Set FAVMyInfo to state=DISABLED 2022-03-24 01:46:18,156 INFO [PEWorker-6] procedure2.ProcedureExecutor: Finished pid=29, state=SUCCESS; DisableTableProcedure table=FAVMyInfo in 637 msec 2022-03-24 01:46:20,752 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16000] master.HMaster: Client=hbuser//172.25.0.1 truncate FAVMyInfo 2022-03-24 01:46:21,424 WARN [PEWorker-7] procedure.DeleteTableProcedure: Deleting some vestigial 1 rows of FAVMyInfo from hbase:meta 2022-03-24 01:46:22,944 INFO [PEWorker-7] hbase.MetaTableAccessor: Deleted 1 regions from META 2022-03-24 01:46:22,961 INFO [PEWorker-7] hbase.MetaTableAccessor: Deleted table FAVMyInfo state from META 2022-03-24 01:46:23,141 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: creating {ENCODED => 64c556d99d19fc4b9eb5d61b39d60793, NAME => 'FAVMyInfo,,1648057581054.64c556d99d19fc4b9eb5d61b39d60793.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='FAVMyInfo', {NAME => 'Personal', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://C1hb-hdfs:9000/hbase/.tmp 2022-03-24 01:46:23,203 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: Closing region FAVMyInfo,,1648057581054.64c556d99d19fc4b9eb5d61b39d60793. 2022-03-24 01:46:23,204 INFO [RegionOpenAndInit-FAVMyInfo-pool-0] regionserver.HRegion: Closed FAVMyInfo,,1648057581054.64c556d99d19fc4b9eb5d61b39d60793. 2022-03-24 01:46:23,241 INFO [PEWorker-7] hbase.MetaTableAccessor: Added 1 regions to meta. 2022-03-24 01:46:33,053 WARN [WorkerMonitor] procedure2.ProcedureExecutor: Worker stuck PEWorker-7(pid=32), run time 12.1840 sec